-- Logs begin at Mon 2022-08-29 18:15:29 UTC, end at Mon 2022-08-29 19:24:58 UTC. -- Aug 29 18:59:01.686130 dv-cinder-731261-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 18:59:01.695478 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 18:59:01.697480 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 18:59:01 2022] *** Aug 29 18:59:01.697480 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 18:59:01.697480 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 18:59:01.697480 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: nodename: dv-cinder-731261-6-iscsi Aug 29 18:59:01.697480 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: machine: x86_64 Aug 29 18:59:01.697480 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: clock source: unix Aug 29 18:59:01.697480 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: pcre jit disabled Aug 29 18:59:01.697480 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: detected number of CPU cores: 4 Aug 29 18:59:01.697480 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: current working directory: / Aug 29 18:59:01.697480 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: detected binary path: /usr/bin/uwsgi-core Aug 29 18:59:01.698163 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: your processes number limit is 47680 Aug 29 18:59:01.698163 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: your memory page size is 4096 bytes Aug 29 18:59:01.698163 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: detected max file descriptor number: 2048 Aug 29 18:59:01.698163 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: lock engine: pthread robust mutexes Aug 29 18:59:01.698163 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: thunder lock: enabled Aug 29 18:59:01.698163 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 18:59:01.698163 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 18:59:01.738438 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: Python main interpreter initialized at 0x55759d3fe9c0 Aug 29 18:59:01.738438 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: python threads support enabled Aug 29 18:59:01.738438 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: your server socket listen backlog is limited to 100 connections Aug 29 18:59:01.738438 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: your mercy for graceful operations on workers is 90 seconds Aug 29 18:59:01.739006 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 18:59:01.739006 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: *** Operational MODE: preforking *** Aug 29 18:59:01.741184 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: *** uWSGI is running in multiple interpreter mode *** Aug 29 18:59:01.741184 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: spawned uWSGI master process (pid: 100938) Aug 29 18:59:01.741184 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: spawned uWSGI worker 1 (pid: 100939, cores: 1) Aug 29 18:59:01.741184 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: spawned uWSGI worker 2 (pid: 100940, cores: 1) Aug 29 18:59:01.741184 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 18:59:01.739367 dv-cinder-731261-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 18:59:02.416498 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 18:59:02.421775 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 18:59:03.532622 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:59:03.532622 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: from cryptography.utils import int_from_bytes Aug 29 18:59:03.533254 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:59:03.533254 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: from cryptography.utils import int_from_bytes Aug 29 18:59:03.535650 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:59:03.535650 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: from cryptography.utils import int_from_bytes Aug 29 18:59:03.536068 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 18:59:03.536068 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: from cryptography.utils import int_from_bytes Aug 29 18:59:06.099148 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 18:59:06.099784 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 18:59:06.099900 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 18:59:06.100201 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 18:59:06.100460 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 18:59:06.100855 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.101183 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.101507 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.101828 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.102159 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.102470 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.102796 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.103287 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.103692 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.103958 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.104279 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.104609 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-731261-6-iscsi {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.104933 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.105246 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.105564 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.105886 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.106190 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.106515 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.106832 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.107368 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.107826 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.108143 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.108454 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.108799 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.109116 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.109428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.110319 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.110713 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.111051 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.111398 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.111803 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-731261-6-iscsi {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.112136 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.112453 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.113604 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.113604 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.114056 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.114056 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.114344 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.114630 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.114942 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.115294 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.115627 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.115948 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.116270 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.116575 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.116973 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.117198 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.117515 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.118755 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.118755 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.118755 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.118755 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.119147 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.119312 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.119666 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.119912 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.120017 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 18:59:06.120450 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.120554 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 18:59:06.120645 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.120797 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.120949 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 18:59:06.121089 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.121229 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 18:59:06.121393 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.121510 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 18:59:06.121921 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.122095 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.122190 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.122273 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.122365 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.122569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.122686 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.122895 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.122998 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.123270 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.123380 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.123585 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.123678 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.123909 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.124053 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.124232 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.124364 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.124505 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.124688 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.124823 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.124919 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.125159 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-731261-6-iscsi {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.125264 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.125550 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.125665 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.126353 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.126443 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.126670 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.126787 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.126993 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.127264 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.127430 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.127569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.127658 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.127778 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.127919 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.128104 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.128429 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.128533 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.128739 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.128826 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.129043 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.129133 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.129350 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.129440 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.129671 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.129770 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.129985 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.130076 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.130293 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.130385 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.130546 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.130649 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.130853 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.130955 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.131188 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.131279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.131513 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.131619 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.131823 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.131911 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-731261-6-iscsi {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.132132 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.132228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.132441 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.132528 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.132744 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.132831 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.133054 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.133210 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.133361 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.133520 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.133668 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.133827 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.133977 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.134147 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.134285 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.134478 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.134593 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.134783 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.134884 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.135126 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.135216 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.135447 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.135538 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.135763 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.135865 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.136080 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.136176 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.136379 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.136478 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.136682 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.136783 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.136988 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.137086 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.137304 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.137404 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.137606 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.137708 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.137908 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.137995 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.138155 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.138243 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.138457 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.138582 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.138773 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.138885 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.139104 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.139205 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.139422 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.139526 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.139672 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.139766 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.139919 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.140041 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.140234 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.140345 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.140553 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.140646 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.140862 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.140979 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.141227 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.141495 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.141828 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.141917 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.141997 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.142112 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.142222 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.142425 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.142516 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.142737 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.142830 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.143047 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.143232 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.143381 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.143475 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.143691 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.143779 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.144000 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.144110 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.144306 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.144401 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.144630 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.144719 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.144956 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.145049 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.145264 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.145356 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.145571 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.145671 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.145881 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.145977 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.146206 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.146302 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.146512 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.146607 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.146831 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.146925 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.147179 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.147282 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.147487 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.147600 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.147792 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.147888 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.148096 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.148196 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.148418 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.148523 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.148749 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.148841 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.149054 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.149145 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.149302 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.149435 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.149604 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.149751 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.149906 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.150066 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.150494 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.150649 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.150801 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.150971 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.151130 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.151320 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.151423 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.151658 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.151748 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.151981 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.152074 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.152300 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.152457 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.152602 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.152689 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.152906 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.153006 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.153211 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.153303 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.153513 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.153616 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.153818 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.153906 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.154121 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.154210 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.154423 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.154512 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.154740 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.154841 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.155059 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.155176 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.155396 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.155489 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.155700 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.155802 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.156003 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.156101 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.156308 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.156409 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.156665 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.156792 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.157013 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.157168 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.157316 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.157423 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.157640 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.157728 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.157942 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.158029 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.158244 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.158353 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.158561 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.158662 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.158864 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.158960 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.159194 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.159288 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.159509 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.159620 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.159808 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.159896 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.160113 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.160216 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.160437 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.160536 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.160745 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.160848 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.161050 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.161142 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.161351 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.161453 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.161652 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.161743 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.161955 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.162043 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.162258 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.162355 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.162561 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.162659 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.162863 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.162951 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.163188 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.163292 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.163508 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.163596 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.163813 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.163901 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.164126 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.164227 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.164431 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.164568 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.164737 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.164868 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.165055 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 18:59:06.165154 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.165366 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.165453 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.165703 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.165791 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.166017 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.166106 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.166332 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.166435 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.166650 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.166797 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.166964 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.167056 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.167298 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.167387 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.167613 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.167704 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.167925 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.168015 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.168234 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.168323 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.168547 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.168647 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.168860 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.168959 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.169165 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.169256 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.169477 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.169603 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.169814 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.169915 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.170153 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.170263 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.170493 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.170596 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.170828 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.170982 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.171150 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.171254 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.171464 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.171567 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.171777 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.171888 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.172103 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.172730 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.173013 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.173175 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.173331 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.173430 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.173677 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.173804 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.174040 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.174152 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.174337 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.174465 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.174662 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.174796 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.174983 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.175135 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.175319 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.175465 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.175630 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.175777 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.175950 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.176094 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.176246 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.176406 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.176581 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.176717 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.176893 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.177027 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.177210 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.177339 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.177523 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.177648 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.177845 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.177942 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.178157 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.178261 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.178468 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.178568 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.178779 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.178870 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.179103 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.179210 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.179415 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.179522 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.179751 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.179842 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.180066 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.180166 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.180371 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.180472 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.180698 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.180787 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.181011 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.181104 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.181366 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.181474 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.181637 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.181905 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.181999 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.182081 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.182242 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.182334 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.182545 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.182637 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.182848 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.182951 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.183182 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.183288 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.183491 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.183585 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.183796 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.183911 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.184119 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.184215 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.184439 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.184526 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.184747 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.184899 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.185065 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.185169 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.185371 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.185467 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.185680 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.185781 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.185992 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.186128 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.186301 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.186402 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.186605 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.186718 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.186922 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.187009 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.187272 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.187361 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.187576 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.187679 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.188557 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.188798 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.188898 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.189109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.189317 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.189423 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.189655 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.189803 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.190079 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.190179 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.190286 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.190376 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.190605 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.190693 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.190916 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.191003 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.191250 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.191341 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.191561 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.191667 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.191877 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.191974 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.192192 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.192284 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.192495 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.192591 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.192821 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.192918 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.193143 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.193308 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.193464 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.193603 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.193737 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.193888 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.194065 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.194224 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.194383 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.194529 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.194673 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.194830 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.194975 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.195149 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.195301 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.195409 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.195606 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.195711 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.195909 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.196003 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.196218 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.196317 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.196517 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.196608 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.196821 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.196924 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.197126 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.197222 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.197430 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.197522 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.197736 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.197836 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.198056 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.198163 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.198366 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.198463 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.198672 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.198764 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.198971 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.199101 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.199297 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.199391 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.199606 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.199705 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.199914 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.200071 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.200229 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.200326 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.200556 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.200660 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.200873 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.200990 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.201196 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.201285 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.201511 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.201611 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.201817 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.201932 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.202123 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.202221 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.202435 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.202524 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.202745 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.202858 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.203052 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.203184 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.203382 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.203506 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.203966 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.204303 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.204439 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.204528 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.204619 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.204702 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.204807 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.204896 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.205014 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.205093 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.205333 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.205432 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.205636 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.205737 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.205948 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.206046 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.206288 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.206380 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.206600 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.206689 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.206924 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.207020 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.207272 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.207380 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.207583 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.207685 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.207895 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.207982 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.208203 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.208315 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.208513 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.208602 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.208823 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.208925 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.209131 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.209229 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.209446 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.209536 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.209757 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.209855 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.210070 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.210180 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.210375 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.210463 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.210689 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.210781 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.210996 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.211132 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.211338 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.211613 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.211706 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.211940 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.212037 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.212258 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.212346 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.212583 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.212674 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.212893 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.212994 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.213203 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.213305 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.213524 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.213626 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.213835 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.213935 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.214140 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.214244 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.214449 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.214560 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.214755 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.214848 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.215057 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.215204 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.215386 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.215493 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.215699 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.215803 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.216006 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.216094 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.216311 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.216402 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.216612 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.216725 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.216922 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.217011 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.217226 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.217332 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.217530 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.217633 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.217829 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.217967 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.218133 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.218225 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.218450 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.218548 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.218759 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.218855 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.219328 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.219483 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.219779 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.219950 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.220084 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.220173 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.220173 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.220298 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.220394 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.220475 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.220650 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.220757 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.220951 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.221044 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.221256 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.221361 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.221562 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.221658 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.221924 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.222020 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.222256 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.222346 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.222559 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.222647 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.222876 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.222972 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.223220 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.223310 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.223556 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.223665 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.223865 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.223964 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.224174 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.224270 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.225784 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.225898 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.225898 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.226124 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.226216 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.226600 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.226681 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.226760 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.226842 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.226919 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.226989 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227055 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227203 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227288 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227369 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227475 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227563 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227632 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227765 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227841 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227909 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.227975 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.228040 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.228106 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.228172 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.228401 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.228499 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.228707 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.228796 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.229019 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.229328 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.229425 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.229631 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.229723 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.229946 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.230035 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.230253 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.230349 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.230573 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.230661 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.230883 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.230977 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.231217 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.231319 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.231525 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.231638 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.231839 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.231947 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.232155 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.232246 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.232462 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.232551 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.232797 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.232945 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.233110 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.233264 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.233418 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.233587 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.233716 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.233804 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.234012 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.234180 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.234318 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.234408 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.234623 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.235265 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.235802 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.236043 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.236174 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.236611 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.237459 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.237712 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.237856 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.238012 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.238132 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.238308 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.238409 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.238491 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.238583 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.238682 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.238765 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.238842 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.238910 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.238977 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.239051 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.239207 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.239317 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.239403 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.239488 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.239570 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.239647 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.239721 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.239802 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.239890 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.240030 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.240171 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.240329 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.240479 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.240617 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.240758 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.240907 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.241062 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.241206 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.241347 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.241498 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.241639 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.241813 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.241969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.242100 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.242221 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.242408 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.242534 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.242711 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.242811 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.243021 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.243133 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.243355 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.243443 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.243660 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.243821 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.243972 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.244062 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.244281 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.244375 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.244590 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.244688 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.244900 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.244996 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.245202 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.245290 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.245509 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.245596 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.245810 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.245905 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.246122 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.246215 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.246430 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.246519 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.246734 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.246822 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.247037 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.247263 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.247366 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.247494 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.247662 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.247832 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.247964 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.248129 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.248272 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.248445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.248575 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.248760 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.248889 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.249073 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.249195 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.249392 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.249556 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.249703 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.249794 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.250018 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.250114 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.250393 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.251058 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.251260 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.251517 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.251625 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.251850 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.251941 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.252166 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.252253 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.252475 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.252564 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.252782 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.252869 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.253095 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.253191 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.253397 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.253493 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.253700 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.253788 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.254012 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.254117 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.254323 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.254410 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.254632 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.254719 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.254935 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.255030 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.255269 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.255358 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.255571 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.255699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.255877 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.256018 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.256180 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.256335 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.256488 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.256645 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.256790 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.257010 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.257121 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.257269 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.257382 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.257595 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.257690 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.257916 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.258011 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.258225 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.258314 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.258582 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.258669 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.258886 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.258982 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.259213 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.259307 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.259644 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.259837 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.259924 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.260006 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.260156 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.260258 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.260466 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.260563 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.260869 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.260972 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.261103 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.261201 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.261412 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.261511 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.261718 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.261807 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.262026 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.262114 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.262337 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.262439 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.262640 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.262728 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.262952 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.263078 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.263286 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.263393 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.263599 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.263733 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.263923 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.264203 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.264370 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.264462 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.264565 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.264777 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.264936 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.265106 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.265351 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.265439 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.265899 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.266035 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.266110 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.266177 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.267983 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.271639 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.271740 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.271813 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.271897 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.271995 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272073 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272154 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272223 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272289 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272364 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272456 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272537 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272624 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272704 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272782 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272861 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.272948 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273035 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273116 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273201 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273281 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273367 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273367 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273528 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273619 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273692 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273758 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273852 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.273934 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274014 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274099 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274168 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274234 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274309 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274389 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274467 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274534 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274600 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274677 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274764 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274764 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274909 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.274987 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.275065 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.275417 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.275417 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.275582 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.275660 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.275829 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.275977 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.275977 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.276129 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.276209 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.276297 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.276377 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.276456 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.276523 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.276590 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.276656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.276743 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.276836 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.276917 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.277005 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.277085 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.277424 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.277514 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.277739 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.277826 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.278050 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.278144 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.278362 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.278453 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.278668 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.278755 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.278998 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.279122 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.279304 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.279394 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.279628 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.279723 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.279934 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.280022 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.280245 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.280338 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.280550 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.280646 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.280873 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.280975 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.281178 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.281267 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.281498 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.281608 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.281885 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.282039 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.282207 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.282297 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.282529 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.282617 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.282859 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.282968 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.283193 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.283298 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.283503 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.283600 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.283854 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.283966 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.284169 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.284314 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.284482 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.284572 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.284789 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.284879 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.285103 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.285191 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.285407 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.285494 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.285713 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.285803 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.286017 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.286106 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.286334 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.286421 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.286640 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.286729 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.286941 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.287030 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.287287 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.287402 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.287605 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.287701 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.287912 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.288009 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.288220 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.288321 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.288570 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.288659 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.288881 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.288969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.289262 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.289405 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.289515 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.289621 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.289840 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.289929 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.290144 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.290241 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.290452 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.290541 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.290761 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.290851 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.291088 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.291181 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.291389 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.291495 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.291711 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.291799 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.292012 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.292101 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.292323 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.292412 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.292633 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.292722 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.292941 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.293032 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.293244 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.293333 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.293546 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.293820 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.293918 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.294153 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.294243 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.294473 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.294576 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.294786 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.294875 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.295121 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.295225 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.295442 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.295539 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.295745 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.295836 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.296060 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.296204 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.296366 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.296461 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.296669 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.296759 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.296971 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.297060 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.297850 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.297986 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.298207 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.298429 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.298583 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.298736 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.298881 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.298966 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.299199 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.299293 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.299520 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.299609 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.299837 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.299948 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.300153 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.300242 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.300481 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.300569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.300803 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.300904 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.301117 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.301206 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.301434 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.301521 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.301735 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.301831 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.302037 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.302126 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.302345 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.302434 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.302647 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.302738 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.302949 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.303040 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.303275 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.303365 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.303584 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.303675 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.303885 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.303975 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.304188 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.304292 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.304489 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.304586 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.304811 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.304911 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.305115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.305223 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.305436 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.305531 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.305747 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.305840 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.306051 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.306150 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.306356 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.306456 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.306659 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.306896 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.307027 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.307243 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.307347 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.307584 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.307673 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.307919 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.308032 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.308246 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.308351 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.308561 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.308662 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.308873 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.308986 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.309187 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.309290 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.309501 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.309601 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.309812 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.309914 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.310123 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.310216 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.310432 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.310520 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.310745 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.310840 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.311055 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.311209 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.311388 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.311479 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.311697 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.311787 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.312023 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.312257 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.312352 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.312591 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.312899 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.313505 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.313813 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.314135 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.314241 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.314471 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.314806 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.314944 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.315161 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.315290 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.315456 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.315553 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.315774 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.316090 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.316287 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.316438 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.316607 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.316760 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.316924 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.317048 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.317248 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.317340 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.317569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.317671 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.317921 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.318072 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.318196 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.318375 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.318519 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.318614 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.318835 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.318944 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.319240 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.319344 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.319490 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.319666 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.319802 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.319978 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.320134 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.320226 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.320468 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.320559 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.320788 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.320887 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.321105 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.321220 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.321426 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.321516 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.321739 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.321832 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.322048 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.322145 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.322357 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.322448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.322668 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.322769 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.322978 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.323098 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.323316 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.323409 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.323628 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.323737 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.323938 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.324029 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.324253 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.324365 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.324562 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.324662 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.324875 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.324965 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.325195 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.325330 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.325506 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.325607 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.325845 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.326061 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.326150 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.326389 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.326538 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.326728 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.326830 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.327059 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.327206 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.327398 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.327499 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.327713 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.327802 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.328030 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.328126 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.328363 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.328452 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.328673 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.328928 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.329048 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.329311 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.329461 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.329636 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.329777 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.329938 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.330038 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.330262 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.330353 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.330576 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.330680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.330882 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.330977 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.331215 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.331314 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.331532 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.331630 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.331845 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.332068 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.332162 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.332417 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.332520 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.332813 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.332923 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.333060 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.333149 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.333371 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.333470 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.333682 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.333776 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.333988 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.334088 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.334297 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.334389 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.334607 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.334700 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.334911 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.334999 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.335421 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.335558 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.335656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.335866 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.335970 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.336244 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.336347 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.336593 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.336885 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.336981 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.337204 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.337312 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.337512 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.337606 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.337826 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.337918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.338133 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.338235 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.338444 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.338532 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.338755 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.338854 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.339060 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.339184 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.339387 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.339486 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.339699 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.339789 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.340006 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.340103 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.340310 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.340412 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.340616 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.340731 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.340920 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.341040 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.341233 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.341364 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.341542 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.341690 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.341853 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.342002 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.342157 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.342333 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.342468 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.342661 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.342772 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.342977 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.343113 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.343399 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.343488 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.343716 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.343819 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.344064 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.344169 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.344423 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.344754 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.344855 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.345084 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.345179 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.345393 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.345532 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.345702 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.345804 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.346011 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.346110 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.346322 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.346416 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.346737 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.346852 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.347054 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.347176 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.347387 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.347632 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.347745 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.347967 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.348056 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.348284 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.348379 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.348589 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.348679 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.348898 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.348998 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.349250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.349355 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.349515 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.349612 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.349816 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.349904 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.350121 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.350209 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.350426 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.350522 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.350732 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.350833 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.351037 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.351160 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.351367 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.351462 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.351673 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.351761 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.351979 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.352074 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.352283 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.352371 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.352586 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.352673 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.352891 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.352986 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.353202 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.353332 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.353501 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.353593 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.353807 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.353909 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.354113 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.354216 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.354420 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.354511 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.354733 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.354823 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.355093 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.355185 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.355409 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.355495 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.355727 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.355831 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.356041 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.356136 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.356358 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.356445 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.356665 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.356761 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.356976 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.357072 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.357284 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.357397 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.357591 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.357688 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.357900 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.357989 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.358215 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.358358 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.358529 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.358619 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.358832 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.358940 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.359189 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.359303 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.359518 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.359607 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.360405 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.360512 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.360726 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.360864 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.361083 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.361171 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.361384 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.361463 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.361708 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.361807 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.362021 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.362111 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.362346 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.362437 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.362656 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.362745 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.362970 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.363057 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.363320 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.363443 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.363636 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.363746 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.363952 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.364061 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.364260 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.364374 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.364563 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.364653 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.364867 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.364956 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.365178 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.365277 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.365496 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.365588 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.365805 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.365918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.366104 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.366205 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.366426 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.366564 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.366715 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.366806 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.367154 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.367262 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.367345 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.367443 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.367639 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.367748 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.367941 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.368088 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.368247 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.368421 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.368548 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.368751 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.368866 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.369056 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.369159 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.369368 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.369471 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.369611 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100940) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 18:59:06.369716 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.370004 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.370311 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.370615 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.370918 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.371257 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.371564 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.371867 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.372195 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.372532 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.372846 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.373167 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.373476 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.373795 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.374102 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.374422 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.374742 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.375058 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.375433 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.376265 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.376641 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.376912 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.377193 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.377501 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.377814 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.378120 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.378448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.378772 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.379111 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.379423 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.379739 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.380057 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.380373 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.380684 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.381013 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.381322 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.381632 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.381941 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.382250 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.382562 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.382878 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.383207 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.383518 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.383830 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.384145 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.384471 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.384796 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.385106 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.385430 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.385756 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.386104 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.386418 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.386763 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.387107 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.387427 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.387737 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.388041 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 18:59:06.388281 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100939) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 18:59:06.528119 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO dbcounter [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Registered counter for database nova_api Aug 29 18:59:06.543970 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO dbcounter [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Registered counter for database nova_api Aug 29 18:59:06.553300 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_db.sqlalchemy.engines [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:59:06.560126 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writer thread running {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:59:06.565924 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG oslo_db.sqlalchemy.engines [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:59:06.574398 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG dbcounter [-] [100939] Writer thread running {{(pid=100939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:59:06.619925 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.context [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85f87a18-97fd-4459-bb91-024e0266a783(cell1) {{(pid=100940) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 18:59:06.623741 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:06.624233 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:06.626016 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:06.626777 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:06.627258 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:06.629254 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:06.631298 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO dbcounter [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Registered counter for database nova_cell0 Aug 29 18:59:06.633076 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.context [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85f87a18-97fd-4459-bb91-024e0266a783(cell1) {{(pid=100939) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 18:59:06.635457 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO dbcounter [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Registered counter for database nova_cell1 Aug 29 18:59:06.636966 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG oslo_concurrency.lockutils [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:06.637438 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG oslo_concurrency.lockutils [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:06.639003 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG oslo_concurrency.lockutils [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:06.639764 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG oslo_concurrency.lockutils [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 18:59:06.640209 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG oslo_concurrency.lockutils [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 18:59:06.642776 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG oslo_concurrency.lockutils [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100939) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 18:59:06.643297 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_db.sqlalchemy.engines [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:59:06.644830 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_db.sqlalchemy.engines [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:59:06.644994 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO dbcounter [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Registered counter for database nova_cell0 Aug 29 18:59:06.649140 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO dbcounter [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Registered counter for database nova_cell1 Aug 29 18:59:06.652598 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writer thread running {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:59:06.652944 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writer thread running {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:59:06.656418 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG oslo_db.sqlalchemy.engines [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:59:06.660621 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG oslo_db.sqlalchemy.engines [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:59:06.663062 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG dbcounter [-] [100939] Writer thread running {{(pid=100939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:59:06.804775 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO dbcounter [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Registered counter for database nova_cell0 Aug 29 18:59:06.805732 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG dbcounter [-] [100939] Writer thread running {{(pid=100939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:59:06.811641 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_db.sqlalchemy.engines [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100940) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:59:06.816987 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO dbcounter [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Registered counter for database nova_cell0 Aug 29 18:59:06.817229 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writer thread running {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:59:06.826085 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG oslo_db.sqlalchemy.engines [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100939) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 18:59:06.832751 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG dbcounter [-] [100939] Writer thread running {{(pid=100939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 18:59:07.164299 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: WARNING keystonemiddleware.auth_token [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 18:59:07.171598 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: WARNING keystonemiddleware.auth_token [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 18:59:07.171860 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: WARNING keystonemiddleware.auth_token [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 18:59:07.180096 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: WARNING keystonemiddleware.auth_token [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 18:59:07.516130 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: WARNING keystonemiddleware.auth_token [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 18:59:07.522225 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: WARNING keystonemiddleware.auth_token [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 18:59:07.522957 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: WARNING keystonemiddleware.auth_token [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 18:59:07.527746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55759d3fe9c0 pid: 100940 (default app) Aug 29 18:59:07.529156 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: WARNING keystonemiddleware.auth_token [None req-dc7f307a-94d4-47ed-92fb-6b2ae5162ba9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 18:59:07.529795 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 18:59:07.530995 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] 10.222.0.94 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001735 Aug 29 18:59:07.531421 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 1/1] 10.222.0.94 () {50 vars in 788 bytes} [Mon Aug 29 18:59:07 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 18:59:07.535475 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55759d3fe9c0 pid: 100939 (default app) Aug 29 19:00:29.458527 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:29.459568 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 29 19:00:29.459971 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 2/2] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:00:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:00:29.473068 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG dbcounter [-] [100939] Writing DB stats nova_api:SELECT=3 {{(pid=100939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:29.474493 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG dbcounter [-] [100939] Writing DB stats nova_cell0:SELECT=3 {{(pid=100939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:29.475672 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG dbcounter [-] [100939] Writing DB stats nova_cell1:SELECT=3 {{(pid=100939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:29.476872 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG dbcounter [-] [100939] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=100939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:30.412390 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-38b97d3f-83d1-4c6a-bd8a-5cc257d8eecc admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:30.448032 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-38b97d3f-83d1-4c6a-bd8a-5cc257d8eecc admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.980942 Aug 29 19:00:30.448888 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 1/3] 10.222.0.94 () {60 vars in 1292 bytes} [Mon Aug 29 19:00:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:32.843534 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:32.844545 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-942bc46c-8d2b-427f-861f-7190578e3859 None None] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 29 19:00:32.845112 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 3/4] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:00:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:00:33.295623 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-85c1b03b-ae73-4459-89c9-8eb3d292a810 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "swap": 0}} {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:33.346059 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-85c1b03b-ae73-4459-89c9-8eb3d292a810 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.494303 Aug 29 19:00:33.346697 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 2/5] 10.222.0.94 () {64 vars in 1283 bytes} [Mon Aug 29 19:00:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:00:33.361044 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writing DB stats nova_api:SELECT=3 {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:33.361851 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writing DB stats nova_cell1:SELECT=3 {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:33.362803 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writing DB stats nova_cell0:SELECT=3 {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:33.364190 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:00:33.571868 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-d9c6f7c3-f753-45d3-adec-3845dd61b6e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:33.650309 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-d9c6f7c3-f753-45d3-adec-3845dd61b6e4 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294372 Aug 29 19:00:33.650810 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 4/6] 10.222.0.94 () {64 vars in 1336 bytes} [Mon Aug 29 19:00:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:36.053194 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-85c1b03b-ae73-4459-89c9-8eb3d292a810 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:36.054240 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-85c1b03b-ae73-4459-89c9-8eb3d292a810 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001553 Aug 29 19:00:36.054657 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 3/7] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:00:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:00:36.752723 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-703d774f-b4d5-482e-89bc-105894d692a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "id": "d1", "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:36.795354 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-703d774f-b4d5-482e-89bc-105894d692a6 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.733952 Aug 29 19:00:36.796358 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 5/8] 10.222.0.94 () {64 vars in 1283 bytes} [Mon Aug 29 19:00:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:00:36.810285 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-e6651d8b-2d2f-4473-a45c-d28e19eed44b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:36.852686 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-e6651d8b-2d2f-4473-a45c-d28e19eed44b admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046413 Aug 29 19:00:36.853507 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 4/9] 10.222.0.94 () {64 vars in 1336 bytes} [Mon Aug 29 19:00:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:39.305425 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-703d774f-b4d5-482e-89bc-105894d692a6 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:39.306650 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-703d774f-b4d5-482e-89bc-105894d692a6 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 Aug 29 19:00:39.307051 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 6/10] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:00:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:00:39.716873 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-66b9146f-651d-42f0-970b-58c160015156 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "swap": 0, "disk": 10}} {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:39.735496 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-66b9146f-651d-42f0-970b-58c160015156 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422057 Aug 29 19:00:39.736098 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 5/11] 10.222.0.94 () {64 vars in 1283 bytes} [Mon Aug 29 19:00:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:00:39.748236 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-f1948599-181e-4b0a-9307-9ef8db858365 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:39.773149 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-f1948599-181e-4b0a-9307-9ef8db858365 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028546 Aug 29 19:00:39.773935 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 7/12] 10.222.0.94 () {64 vars in 1336 bytes} [Mon Aug 29 19:00:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:42.157241 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-66b9146f-651d-42f0-970b-58c160015156 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:42.158264 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-66b9146f-651d-42f0-970b-58c160015156 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 29 19:00:42.158666 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 6/13] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:00:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:00:42.637582 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-8d7ee152-b025-4dd2-ad72-1a2ca5fe2cc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "swap": 0, "id": "d3", "rxtx_factor": 1.0}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:42.665140 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-8d7ee152-b025-4dd2-ad72-1a2ca5fe2cc2 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500214 Aug 29 19:00:42.665688 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 8/14] 10.222.0.94 () {64 vars in 1283 bytes} [Mon Aug 29 19:00:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:00:42.679113 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-3498771e-cdf0-436a-9fd3-a81453200248 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:42.705371 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-3498771e-cdf0-436a-9fd3-a81453200248 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031265 Aug 29 19:00:42.705946 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 7/15] 10.222.0.94 () {64 vars in 1336 bytes} [Mon Aug 29 19:00:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:00:45.114520 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-8d7ee152-b025-4dd2-ad72-1a2ca5fe2cc2 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:45.115552 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-8d7ee152-b025-4dd2-ad72-1a2ca5fe2cc2 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 29 19:00:45.116124 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 9/16] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:00:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:00:45.579048 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-e5fa0b3f-c3c3-4fd2-900a-c5d804b4d38a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20}} {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:45.598624 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-e5fa0b3f-c3c3-4fd2-900a-c5d804b4d38a admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476150 Aug 29 19:00:45.599421 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 8/17] 10.222.0.94 () {64 vars in 1283 bytes} [Mon Aug 29 19:00:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:00:45.612809 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-3a26190a-6901-4960-bc07-94f683e91ab8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:45.639206 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-3a26190a-6901-4960-bc07-94f683e91ab8 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031365 Aug 29 19:00:45.640100 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 10/18] 10.222.0.94 () {64 vars in 1336 bytes} [Mon Aug 29 19:00:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:00:48.190672 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-e5fa0b3f-c3c3-4fd2-900a-c5d804b4d38a admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:48.191792 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-e5fa0b3f-c3c3-4fd2-900a-c5d804b4d38a admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Aug 29 19:00:48.192195 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 9/19] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:00:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:00:48.611157 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-2d0cf553-cf9c-4b69-ad39-9c0c4becfad9 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:48.638957 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-2d0cf553-cf9c-4b69-ad39-9c0c4becfad9 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.440434 Aug 29 19:00:48.639465 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 11/20] 10.222.0.94 () {60 vars in 1292 bytes} [Mon Aug 29 19:00:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:00:51.000528 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-e5fa0b3f-c3c3-4fd2-900a-c5d804b4d38a admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:51.001484 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-e5fa0b3f-c3c3-4fd2-900a-c5d804b4d38a admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 29 19:00:51.001834 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 10/21] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:00:51.465105 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-0171ca0b-4269-4c82-a770-4a5a84d870fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "swap": 0, "vcpus": 1, "ram": 512, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:51.485880 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-0171ca0b-4269-4c82-a770-4a5a84d870fa admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.477353 Aug 29 19:00:51.486388 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 12/22] 10.222.0.94 () {64 vars in 1283 bytes} [Mon Aug 29 19:00:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:00:51.499397 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-50e4bbf0-d369-4262-b3d8-1021c0d568df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:51.524966 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-50e4bbf0-d369-4262-b3d8-1021c0d568df admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029140 Aug 29 19:00:51.525541 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 11/23] 10.222.0.94 () {64 vars in 1333 bytes} [Mon Aug 29 19:00:51 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:53.980769 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-0171ca0b-4269-4c82-a770-4a5a84d870fa admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:53.981924 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-0171ca0b-4269-4c82-a770-4a5a84d870fa admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Aug 29 19:00:53.982326 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 13/24] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:00:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:00:54.381056 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-90b1f8c2-a8d8-4a23-9f0c-fcdd3e60bc82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "ram": 2048, "disk": 20, "rxtx_factor": 1.0, "id": "2", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:54.400610 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-90b1f8c2-a8d8-4a23-9f0c-fcdd3e60bc82 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.411520 Aug 29 19:00:54.401065 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 12/25] 10.222.0.94 () {64 vars in 1283 bytes} [Mon Aug 29 19:00:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:00:54.413947 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-a0a6a423-96bd-46f5-8855-82db1c0d0494 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:54.438084 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-a0a6a423-96bd-46f5-8855-82db1c0d0494 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027924 Aug 29 19:00:54.438651 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 14/26] 10.222.0.94 () {64 vars in 1333 bytes} [Mon Aug 29 19:00:54 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:56.835292 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-90b1f8c2-a8d8-4a23-9f0c-fcdd3e60bc82 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:56.836326 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-90b1f8c2-a8d8-4a23-9f0c-fcdd3e60bc82 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Aug 29 19:00:56.837020 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 13/27] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:00:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:00:57.230347 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-d25a258c-632c-4de0-ace8-a7f754d88ff9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "disk": 40, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "vcpus": 2}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:57.248720 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-d25a258c-632c-4de0-ace8-a7f754d88ff9 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.405763 Aug 29 19:00:57.249270 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 15/28] 10.222.0.94 () {64 vars in 1283 bytes} [Mon Aug 29 19:00:56 2022] POST /compute/v2.1/flavors => generated 406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:00:57.261949 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-c9c81532-623e-4b69-bdf7-e29aacfd9049 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:00:57.287575 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-c9c81532-623e-4b69-bdf7-e29aacfd9049 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029131 Aug 29 19:00:57.288244 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 14/29] 10.222.0.94 () {64 vars in 1333 bytes} [Mon Aug 29 19:00:57 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:00:59.761496 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-d25a258c-632c-4de0-ace8-a7f754d88ff9 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:00:59.763179 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-d25a258c-632c-4de0-ace8-a7f754d88ff9 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002191 Aug 29 19:00:59.765179 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 16/30] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:00:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:01:00.249310 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-b7e06b6e-0985-43bc-b9e2-5138d932da06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "disk": 80, "id": "4"}} {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:00.256264 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG dbcounter [-] [100939] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=100939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:00.272514 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-b7e06b6e-0985-43bc-b9e2-5138d932da06 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.501258 Aug 29 19:01:00.273363 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 15/31] 10.222.0.94 () {64 vars in 1283 bytes} [Mon Aug 29 19:00:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:01:00.286743 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-3fd2b4f0-fcfb-4a3a-ad43-c6f299b2f02a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:00.312786 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-3fd2b4f0-fcfb-4a3a-ad43-c6f299b2f02a admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030643 Aug 29 19:01:00.313358 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 17/32] 10.222.0.94 () {64 vars in 1333 bytes} [Mon Aug 29 19:01:00 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:01:02.748589 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-b7e06b6e-0985-43bc-b9e2-5138d932da06 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:02.749602 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-b7e06b6e-0985-43bc-b9e2-5138d932da06 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 29 19:01:02.750232 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 16/33] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:01:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:01:03.206312 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-acd121dd-b13d-4a0c-9c65-cc0635925b29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "name": "m1.xlarge"}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:03.227386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-acd121dd-b13d-4a0c-9c65-cc0635925b29 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.470109 Aug 29 19:01:03.228301 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 18/34] 10.222.0.94 () {64 vars in 1283 bytes} [Mon Aug 29 19:01:02 2022] POST /compute/v2.1/flavors => generated 408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:03.242025 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-75d654f3-3196-4524-aaa1-fdfa3623d858 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:03.270460 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-75d654f3-3196-4524-aaa1-fdfa3623d858 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033210 Aug 29 19:01:03.271042 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 17/35] 10.222.0.94 () {64 vars in 1333 bytes} [Mon Aug 29 19:01:03 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:01:23.025748 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-acd121dd-b13d-4a0c-9c65-cc0635925b29 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:23.026689 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-acd121dd-b13d-4a0c-9c65-cc0635925b29 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 29 19:01:23.027115 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 19/36] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:01:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:23.038697 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG dbcounter [-] [100939] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=100939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:23.425815 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-70eb9c30-e6e4-4cce-a922-9f36fff00935 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:23.445040 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-70eb9c30-e6e4-4cce-a922-9f36fff00935 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410999 Aug 29 19:01:23.445572 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 18/37] 10.222.0.94 () {60 vars in 1292 bytes} [Mon Aug 29 19:01:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:01:24.516084 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-acd121dd-b13d-4a0c-9c65-cc0635925b29 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:24.517081 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-acd121dd-b13d-4a0c-9c65-cc0635925b29 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Aug 29 19:01:24.517611 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 20/38] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:01:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:25.048670 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-7f677b07-2ba3-4a78-8543-69dd729ed50d admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:25.054209 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.wsgi [None req-7f677b07-2ba3-4a78-8543-69dd729ed50d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-7f677b07-2ba3-4a78-8543-69dd729ed50d admin admin] Request method failure captured: Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Accept: application/json Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Accept-Encoding: gzip, deflate Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Connection: keep-alive Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Content-Length: 0 Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Host: 10.222.0.94 Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Openstack-Api-Version: compute 2.90 Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Openstack-System-Scope: None Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: User-Agent: python-novaclient Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Auth-Token: gAAAAABjDQ0EKhmTP4EMtRO9M1ponIkQOJtncWYwPPMtUcSKjkpioocaAoSWzs3wdnvogeS3P_b_PnALkNleTkNaLH1m9aMiLf7uFwRd6taneJX6UwXMi0hB_2vCMZuzh6laI1Wkd0MeKa6_K8mAXIirKvXu24fIy6q7Zaq37cc9TPc8y6kvfKQ Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Domain-Id: None Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Domain-Name: None Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Identity-Status: Confirmed Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Is-Admin-Project: True Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Domain-Id: default Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Domain-Name: Default Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Name: admin Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Role: member,admin,reader Aug 29 19:01:25.057480 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Roles: member,admin,reader Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}] Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Tenant: admin Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Tenant-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Tenant-Name: admin Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User: admin Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Domain-Id: default Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Domain-Name: Default Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Id: 2b6bbf928a744f868eafe13f4b7ff775 Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Name: admin Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: method: > Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: exception: Flavor 42 could not be found. Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: action_args: {'id': '42'} Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:01:25.059139 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:25.060115 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:25.061448 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-7f677b07-2ba3-4a78-8543-69dd729ed50d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:01:25.063812 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-7f677b07-2ba3-4a78-8543-69dd729ed50d admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.403211 Aug 29 19:01:25.063812 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 19/39] 10.222.0.94 () {60 vars in 1190 bytes} [Mon Aug 29 19:01:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 19:01:25.069324 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-37e94d09-3756-4081-a66c-072c59e8452c admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:25.073467 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:01:25.093944 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-37e94d09-3756-4081-a66c-072c59e8452c admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028126 Aug 29 19:01:25.094480 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 21/40] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Aug 29 19:01:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:01:25.104277 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-fa0e85d8-359b-4ed9-bd6d-458de7a2ccec admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:25.128147 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-fa0e85d8-359b-4ed9-bd6d-458de7a2ccec admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027377 Aug 29 19:01:25.128683 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 20/41] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Aug 29 19:01:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:01:25.138479 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-4ea14c91-53c5-4668-9816-c05d358a3a0e admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:25.144645 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.wsgi [None req-4ea14c91-53c5-4668-9816-c05d358a3a0e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-4ea14c91-53c5-4668-9816-c05d358a3a0e admin admin] Request method failure captured: Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Accept: application/json Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Accept-Encoding: gzip, deflate Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Connection: keep-alive Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Content-Length: 0 Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Host: 10.222.0.94 Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Openstack-Api-Version: compute 2.90 Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Openstack-System-Scope: None Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: User-Agent: python-novaclient Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Auth-Token: gAAAAABjDQ0EKhmTP4EMtRO9M1ponIkQOJtncWYwPPMtUcSKjkpioocaAoSWzs3wdnvogeS3P_b_PnALkNleTkNaLH1m9aMiLf7uFwRd6taneJX6UwXMi0hB_2vCMZuzh6laI1Wkd0MeKa6_K8mAXIirKvXu24fIy6q7Zaq37cc9TPc8y6kvfKQ Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Domain-Id: None Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Domain-Name: None Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Identity-Status: Confirmed Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Is-Admin-Project: True Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Domain-Id: default Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Domain-Name: Default Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Name: admin Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Role: member,admin,reader Aug 29 19:01:25.147918 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Roles: member,admin,reader Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}] Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Tenant: admin Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Tenant-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Tenant-Name: admin Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User: admin Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Domain-Id: default Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Domain-Name: Default Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Id: 2b6bbf928a744f868eafe13f4b7ff775 Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Name: admin Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: method: > Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: exception: Flavor 42 could not be found. Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: action_args: {'id': '42'} Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:01:25.149445 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:25.150389 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:25.151680 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-4ea14c91-53c5-4668-9816-c05d358a3a0e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:01:25.152929 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-4ea14c91-53c5-4668-9816-c05d358a3a0e admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014938 Aug 29 19:01:25.152929 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 22/42] 10.222.0.94 () {60 vars in 1190 bytes} [Mon Aug 29 19:01:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 29 19:01:26.117505 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-fa0e85d8-359b-4ed9-bd6d-458de7a2ccec admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:26.118508 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-fa0e85d8-359b-4ed9-bd6d-458de7a2ccec admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 29 19:01:26.118895 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 21/43] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:01:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:26.654857 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-c3cd18d4-106d-4e5e-8fbf-204488b7a523 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:26.661249 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.wsgi [None req-c3cd18d4-106d-4e5e-8fbf-204488b7a523 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-c3cd18d4-106d-4e5e-8fbf-204488b7a523 admin admin] Request method failure captured: Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Accept: application/json Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Accept-Encoding: gzip, deflate Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Connection: keep-alive Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Content-Length: 0 Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Host: 10.222.0.94 Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Openstack-Api-Version: compute 2.90 Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Openstack-System-Scope: None Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: User-Agent: python-novaclient Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Auth-Token: gAAAAABjDQ0GBTMeYxl2wW5u-MzZIS5_JIw_MkWItsVkKtP6Wk9UoSOUgMEL87IP0ZDRS3wE8vd_F5JhjH3oD0QKIJDgI-OHM4yCLBm0kBLJdjlTuRNCou6nQdpuTvQqX0sxBa7y-Vr7FnF1NbGJqxI-sqtHpDAYwMPQD-zHGB1S5NlxJwrRb_4 Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Domain-Id: None Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Domain-Name: None Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Identity-Status: Confirmed Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Is-Admin-Project: True Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Domain-Id: default Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Domain-Name: Default Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Name: admin Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Role: member,admin,reader Aug 29 19:01:26.662746 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Roles: member,admin,reader Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}] Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Tenant: admin Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Tenant-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Tenant-Name: admin Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User: admin Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Domain-Id: default Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Domain-Name: Default Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Id: 2b6bbf928a744f868eafe13f4b7ff775 Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Name: admin Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: method: > Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: exception: Flavor 84 could not be found. Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: action_args: {'id': '84'} Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:01:26.664280 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:26.665250 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:26.666699 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-c3cd18d4-106d-4e5e-8fbf-204488b7a523 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:01:26.667996 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-c3cd18d4-106d-4e5e-8fbf-204488b7a523 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.407713 Aug 29 19:01:26.667996 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 23/44] 10.222.0.94 () {60 vars in 1190 bytes} [Mon Aug 29 19:01:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 19:01:26.674165 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-c53de299-8452-4ee3-8977-0ae073779571 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:26.689309 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-c53de299-8452-4ee3-8977-0ae073779571 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019151 Aug 29 19:01:26.689978 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 22/45] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Aug 29 19:01:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:01:26.699525 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-5241ed3b-2bf6-4975-9978-76bbc9382bb1 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:26.714777 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-5241ed3b-2bf6-4975-9978-76bbc9382bb1 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018723 Aug 29 19:01:26.715342 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 24/46] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Aug 29 19:01:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:01:26.725309 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-b68e9cc4-6205-43dc-9c6c-b91a9184e19e admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:26.730590 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.wsgi [None req-b68e9cc4-6205-43dc-9c6c-b91a9184e19e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-b68e9cc4-6205-43dc-9c6c-b91a9184e19e admin admin] Request method failure captured: Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Accept: application/json Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Accept-Encoding: gzip, deflate Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Connection: keep-alive Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Content-Length: 0 Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Host: 10.222.0.94 Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Openstack-Api-Version: compute 2.90 Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Openstack-System-Scope: None Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: User-Agent: python-novaclient Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Auth-Token: gAAAAABjDQ0GBTMeYxl2wW5u-MzZIS5_JIw_MkWItsVkKtP6Wk9UoSOUgMEL87IP0ZDRS3wE8vd_F5JhjH3oD0QKIJDgI-OHM4yCLBm0kBLJdjlTuRNCou6nQdpuTvQqX0sxBa7y-Vr7FnF1NbGJqxI-sqtHpDAYwMPQD-zHGB1S5NlxJwrRb_4 Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Domain-Id: None Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Domain-Name: None Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Identity-Status: Confirmed Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Is-Admin-Project: True Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Domain-Id: default Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Domain-Name: Default Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Name: admin Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Role: member,admin,reader Aug 29 19:01:26.732109 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Roles: member,admin,reader Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}] Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Tenant: admin Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Tenant-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Tenant-Name: admin Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User: admin Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Domain-Id: default Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Domain-Name: Default Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Id: 2b6bbf928a744f868eafe13f4b7ff775 Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Name: admin Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: method: > Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: exception: Flavor 84 could not be found. Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: action_args: {'id': '84'} Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:01:26.734485 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:26.735655 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:26.737279 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-b68e9cc4-6205-43dc-9c6c-b91a9184e19e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:01:26.738295 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-b68e9cc4-6205-43dc-9c6c-b91a9184e19e admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011809 Aug 29 19:01:26.738295 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 23/47] 10.222.0.94 () {60 vars in 1190 bytes} [Mon Aug 29 19:01:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 19:01:27.726530 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-5241ed3b-2bf6-4975-9978-76bbc9382bb1 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:27.727577 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-5241ed3b-2bf6-4975-9978-76bbc9382bb1 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 29 19:01:27.727967 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 25/48] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:01:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:28.266126 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-5bd038f8-cb1d-461f-af1d-24a89b2809b2 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:28.271946 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.wsgi [None req-5bd038f8-cb1d-461f-af1d-24a89b2809b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-5bd038f8-cb1d-461f-af1d-24a89b2809b2 admin admin] Request method failure captured: Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Accept: application/json Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Accept-Encoding: gzip, deflate Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Connection: keep-alive Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Content-Length: 0 Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Host: 10.222.0.94 Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Openstack-Api-Version: compute 2.90 Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Openstack-System-Scope: None Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: User-Agent: python-novaclient Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Auth-Token: gAAAAABjDQ0HuiR9tHCERtXwaTcu2M6IE3-4EdvzYG2cmKJhplBDFgZvSQb5ZecnQdl44uQssQ4alKP52lVXktO78IAywRN3r-nVcK4DjCb6IUy9PskBArNXGAGAd33p_lmXea5YS48x8RjbNmVCEqJ-4rVKTrbdFwUYiKbDuZ157mLjUna5ZRU Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Domain-Id: None Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Domain-Name: None Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Identity-Status: Confirmed Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Is-Admin-Project: True Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Domain-Id: default Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Domain-Name: Default Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Project-Name: admin Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Role: member,admin,reader Aug 29 19:01:28.273450 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Roles: member,admin,reader Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}] Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Tenant: admin Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Tenant-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-Tenant-Name: admin Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User: admin Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Domain-Id: default Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Domain-Name: Default Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Id: 2b6bbf928a744f868eafe13f4b7ff775 Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: X-User-Name: admin Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: method: > Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: exception: Flavor 451 could not be found. Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: action_args: {'id': '451'} Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:01:28.274969 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:28.275959 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: ERROR nova.api.openstack.wsgi Aug 29 19:01:28.277228 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-5bd038f8-cb1d-461f-af1d-24a89b2809b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100939) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:01:28.278735 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-5bd038f8-cb1d-461f-af1d-24a89b2809b2 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.407661 Aug 29 19:01:28.278735 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 24/49] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Aug 29 19:01:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 19:01:28.284986 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-a7a1bf61-7124-4dee-bc80-f629a47088e7 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:28.300142 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-a7a1bf61-7124-4dee-bc80-f629a47088e7 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018976 Aug 29 19:01:28.300678 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 26/50] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Aug 29 19:01:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:01:28.310424 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:28.325747 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] 10.222.0.94 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018851 Aug 29 19:01:28.326278 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 25/51] 10.222.0.94 () {60 vars in 1210 bytes} [Mon Aug 29 19:01:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:01:28.335759 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-e5071295-76f5-4b17-acb3-036334503ae9 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:28.341100 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.wsgi [None req-e5071295-76f5-4b17-acb3-036334503ae9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-e5071295-76f5-4b17-acb3-036334503ae9 admin admin] Request method failure captured: Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Accept: application/json Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Accept-Encoding: gzip, deflate Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Connection: keep-alive Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Content-Length: 0 Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Host: 10.222.0.94 Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Openstack-Api-Version: compute 2.90 Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Openstack-System-Scope: None Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: User-Agent: python-novaclient Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Auth-Token: gAAAAABjDQ0HuiR9tHCERtXwaTcu2M6IE3-4EdvzYG2cmKJhplBDFgZvSQb5ZecnQdl44uQssQ4alKP52lVXktO78IAywRN3r-nVcK4DjCb6IUy9PskBArNXGAGAd33p_lmXea5YS48x8RjbNmVCEqJ-4rVKTrbdFwUYiKbDuZ157mLjUna5ZRU Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Domain-Id: None Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Domain-Name: None Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Identity-Status: Confirmed Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Is-Admin-Project: True Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Domain-Id: default Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Domain-Name: Default Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Project-Name: admin Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Role: member,admin,reader Aug 29 19:01:28.342569 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Roles: member,admin,reader Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/11b2e035c0894ef7a5efbac9016e862c"}]}] Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Tenant: admin Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Tenant-Id: 11b2e035c0894ef7a5efbac9016e862c Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-Tenant-Name: admin Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User: admin Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Domain-Id: default Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Domain-Name: Default Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Id: 2b6bbf928a744f868eafe13f4b7ff775 Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: X-User-Name: admin Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: method: > Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: exception: Flavor 451 could not be found. Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: action_args: {'id': '451'} Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:01:28.344428 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:28.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: ERROR nova.api.openstack.wsgi Aug 29 19:01:28.346656 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-e5071295-76f5-4b17-acb3-036334503ae9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100940) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:01:28.347952 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-e5071295-76f5-4b17-acb3-036334503ae9 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011757 Aug 29 19:01:28.347952 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 27/52] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Aug 29 19:01:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 19:01:29.317396 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:29.318404 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 29 19:01:29.318798 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 26/53] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:01:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:29.860293 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-3daa06a7-274f-4613-8c77-378e8e8a4d07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:29.879548 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-3daa06a7-274f-4613-8c77-378e8e8a4d07 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.420017 Aug 29 19:01:29.880143 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 28/54] 10.222.0.94 () {64 vars in 1235 bytes} [Mon Aug 29 19:01:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:30.887090 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:30.888117 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Aug 29 19:01:30.888511 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 27/55] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:01:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:31.432399 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-86d70ba6-1d2b-4365-8e67-046b53169608 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:31.451814 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-86d70ba6-1d2b-4365-8e67-046b53169608 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.415021 Aug 29 19:01:31.452963 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 29/56] 10.222.0.94 () {64 vars in 1235 bytes} [Mon Aug 29 19:01:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:32.449761 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:32.450773 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Aug 29 19:01:32.451203 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 28/57] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:32.987097 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-659c004e-dd1d-4834-b832-2d9bd2dd7b52 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:33.005728 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-659c004e-dd1d-4834-b832-2d9bd2dd7b52 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.415153 Aug 29 19:01:33.006274 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 30/58] 10.222.0.94 () {64 vars in 1235 bytes} [Mon Aug 29 19:01:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:33.976460 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:33.977473 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 29 19:01:33.977862 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 29/59] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:01:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:34.500405 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-6f7a9f18-2ad9-40a0-a1ef-81786a548584 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:01:34.519120 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-6f7a9f18-2ad9-40a0-a1ef-81786a548584 admin admin] 10.222.0.94 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403949 Aug 29 19:01:34.519670 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 31/60] 10.222.0.94 () {64 vars in 1235 bytes} [Mon Aug 29 19:01:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:01:35.490382 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:35.491434 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 29 19:01:35.491833 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 30/61] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:01:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:01:36.017184 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-7fd9ae68-a5bb-46c3-bcf2-ed9f4e19ee30 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:01:36.037543 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-7fd9ae68-a5bb-46c3-bcf2-ed9f4e19ee30 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.408040 Aug 29 19:01:36.038010 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 32/62] 10.222.0.94 () {60 vars in 1202 bytes} [Mon Aug 29 19:01:35 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:29.734982 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:29.736042 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-22771913-6e28-4806-8c97-797372f3642e admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 29 19:02:29.736439 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 31/63] 10.222.0.94 () {54 vars in 931 bytes} [Mon Aug 29 19:02:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:02:29.748019 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:30.139764 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-0ae9ae15-c427-44a9-b59a-22a139329585 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:30.160270 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-0ae9ae15-c427-44a9-b59a-22a139329585 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.417628 Aug 29 19:02:30.160814 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 33/64] 10.222.0.94 () {60 vars in 1292 bytes} [Mon Aug 29 19:02:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:02:30.181729 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG dbcounter [-] [100939] Writing DB stats nova_api:SELECT=14 {{(pid=100939) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:02:30.186233 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-af28d5d6-a6b2-47cb-89c7-9181944249ac admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:30.193799 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-af28d5d6-a6b2-47cb-89c7-9181944249ac admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013456 Aug 29 19:02:30.194328 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 32/65] 10.222.0.94 () {60 vars in 1283 bytes} [Mon Aug 29 19:02:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:30.209983 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-7871268b-509d-4214-9435-c4d83b191115 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:30.221222 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-7871268b-509d-4214-9435-c4d83b191115 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016931 Aug 29 19:02:30.221999 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 34/66] 10.222.0.94 () {60 vars in 1286 bytes} [Mon Aug 29 19:02:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:30.237583 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-faa7b8cf-3f51-4f35-9769-56e77ef099b0 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:30.246225 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-faa7b8cf-3f51-4f35-9769-56e77ef099b0 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012268 Aug 29 19:02:30.246782 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 33/67] 10.222.0.94 () {60 vars in 1286 bytes} [Mon Aug 29 19:02:30 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:02:30.259195 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-c961e876-c2b4-4ee2-b594-81122e90a477 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:02:30.267402 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-c961e876-c2b4-4ee2-b594-81122e90a477 admin admin] 10.222.0.94 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012070 Aug 29 19:02:30.267916 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 35/68] 10.222.0.94 () {60 vars in 1283 bytes} [Mon Aug 29 19:02:30 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:05:37.738335 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-faa7b8cf-3f51-4f35-9769-56e77ef099b0 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:37.739389 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-faa7b8cf-3f51-4f35-9769-56e77ef099b0 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 29 19:05:37.739788 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 34/69] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:05:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:05:37.881164 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writing DB stats nova_api:SELECT=6 {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:05:38.042520 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-18102d31-b2a3-4eff-a11f-c4934aba376c admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:38.046014 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-18102d31-b2a3-4eff-a11f-c4934aba376c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:38.046491 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-18102d31-b2a3-4eff-a11f-c4934aba376c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:38.046921 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-18102d31-b2a3-4eff-a11f-c4934aba376c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:38.047678 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-18102d31-b2a3-4eff-a11f-c4934aba376c admin admin] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:38.048128 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-18102d31-b2a3-4eff-a11f-c4934aba376c admin admin] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:38.049158 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-18102d31-b2a3-4eff-a11f-c4934aba376c admin admin] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:38.084273 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-18102d31-b2a3-4eff-a11f-c4934aba376c admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.204563 Aug 29 19:05:38.084876 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 36/70] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Aug 29 19:05:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:05:38.916709 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-faa7b8cf-3f51-4f35-9769-56e77ef099b0 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:38.917715 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-faa7b8cf-3f51-4f35-9769-56e77ef099b0 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 29 19:05:38.918112 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 35/71] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:05:39.121632 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-c86d2739-4bb2-4433-aeb5-2efd5307ff54 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:39.125278 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-c86d2739-4bb2-4433-aeb5-2efd5307ff54 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:39.125754 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-c86d2739-4bb2-4433-aeb5-2efd5307ff54 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:39.126185 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-c86d2739-4bb2-4433-aeb5-2efd5307ff54 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:39.126994 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-c86d2739-4bb2-4433-aeb5-2efd5307ff54 admin admin] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:39.127457 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-c86d2739-4bb2-4433-aeb5-2efd5307ff54 admin admin] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:39.127878 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-c86d2739-4bb2-4433-aeb5-2efd5307ff54 admin admin] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:39.148053 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-c86d2739-4bb2-4433-aeb5-2efd5307ff54 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082982 Aug 29 19:05:39.148626 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 37/72] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Aug 29 19:05:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:05:50.398554 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-faa7b8cf-3f51-4f35-9769-56e77ef099b0 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:50.399604 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-faa7b8cf-3f51-4f35-9769-56e77ef099b0 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 29 19:05:50.400000 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 36/73] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:05:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:05:50.549176 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writing DB stats nova_cell0:SELECT=4 {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:05:50.549877 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writing DB stats nova_cell1:SELECT=4 {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:05:50.550538 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG dbcounter [-] [100940] Writing DB stats nova_api:SELECT=8 {{(pid=100940) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:05:50.599842 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-1a147847-1e4f-40f2-b8a0-36ab0e066ec1 admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:50.603286 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-1a147847-1e4f-40f2-b8a0-36ab0e066ec1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:50.603788 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-1a147847-1e4f-40f2-b8a0-36ab0e066ec1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:50.604214 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-1a147847-1e4f-40f2-b8a0-36ab0e066ec1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:50.604921 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-1a147847-1e4f-40f2-b8a0-36ab0e066ec1 admin admin] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:50.605372 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-1a147847-1e4f-40f2-b8a0-36ab0e066ec1 admin admin] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:50.605784 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-1a147847-1e4f-40f2-b8a0-36ab0e066ec1 admin admin] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:50.630836 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-1a147847-1e4f-40f2-b8a0-36ab0e066ec1 admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086233 Aug 29 19:05:50.631446 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 38/74] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Aug 29 19:05:50 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:05:51.455436 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: DEBUG nova.api.openstack.wsgi [None req-faa7b8cf-3f51-4f35-9769-56e77ef099b0 admin admin] Calling method '>' {{(pid=100939) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:51.456564 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: INFO nova.api.openstack.requestlog [None req-faa7b8cf-3f51-4f35-9769-56e77ef099b0 admin admin] 10.222.0.94 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002164 Aug 29 19:05:51.456961 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: [pid: 100939|app: 0|req: 37/75] 10.222.0.94 () {56 vars in 1074 bytes} [Mon Aug 29 19:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:05:51.657761 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG nova.api.openstack.wsgi [None req-60f9b9af-71af-4246-923b-c03a2f4940be admin admin] Calling method '>' {{(pid=100940) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:05:51.661139 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-60f9b9af-71af-4246-923b-c03a2f4940be admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:51.661654 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-60f9b9af-71af-4246-923b-c03a2f4940be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:51.662119 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-60f9b9af-71af-4246-923b-c03a2f4940be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:51.662846 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-60f9b9af-71af-4246-923b-c03a2f4940be admin admin] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:05:51.663414 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-60f9b9af-71af-4246-923b-c03a2f4940be admin admin] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:05:51.663835 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: DEBUG oslo_concurrency.lockutils [None req-60f9b9af-71af-4246-923b-c03a2f4940be admin admin] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=100940) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:05:51.686050 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: INFO nova.api.openstack.requestlog [None req-60f9b9af-71af-4246-923b-c03a2f4940be admin admin] 10.222.0.94 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081469 Aug 29 19:05:51.686602 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: [pid: 100940|app: 0|req: 39/76] 10.222.0.94 () {60 vars in 1193 bytes} [Mon Aug 29 19:05:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:06:49.055579 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: Mon Aug 29 19:06:49 2022 - graceful shutdown triggered... Aug 29 19:06:49.054944 dv-cinder-731261-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 19:06:49.056568 dv-cinder-731261-6-iscsi devstack@n-api.service[100939]: Gracefully killing worker 1 (pid: 100939)... Aug 29 19:06:49.056938 dv-cinder-731261-6-iscsi devstack@n-api.service[100940]: Gracefully killing worker 2 (pid: 100940)... Aug 29 19:06:50.055221 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: worker 1 buried after 1 seconds Aug 29 19:06:50.055437 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: worker 2 buried after 1 seconds Aug 29 19:06:50.055437 dv-cinder-731261-6-iscsi devstack@n-api.service[100938]: goodbye to uWSGI. Aug 29 19:06:50.056817 dv-cinder-731261-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 19:06:50.057366 dv-cinder-731261-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 19:06:50.060172 dv-cinder-731261-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 19:06:50.071656 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 19:06:50.073686 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 19:06:50 2022] *** Aug 29 19:06:50.073686 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 19:06:50.073686 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 19:06:50.073686 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: nodename: dv-cinder-731261-6-iscsi Aug 29 19:06:50.073686 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: machine: x86_64 Aug 29 19:06:50.073686 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: clock source: unix Aug 29 19:06:50.073686 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: pcre jit disabled Aug 29 19:06:50.073686 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: detected number of CPU cores: 4 Aug 29 19:06:50.073686 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: current working directory: / Aug 29 19:06:50.073686 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: detected binary path: /usr/bin/uwsgi-core Aug 29 19:06:50.074449 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: your processes number limit is 47680 Aug 29 19:06:50.074449 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: your memory page size is 4096 bytes Aug 29 19:06:50.074449 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: detected max file descriptor number: 2048 Aug 29 19:06:50.074449 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: lock engine: pthread robust mutexes Aug 29 19:06:50.074449 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: thunder lock: enabled Aug 29 19:06:50.074449 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 19:06:50.074449 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 19:06:50.114384 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: Python main interpreter initialized at 0x55b497dbb9c0 Aug 29 19:06:50.114384 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: python threads support enabled Aug 29 19:06:50.114384 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: your server socket listen backlog is limited to 100 connections Aug 29 19:06:50.114384 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: your mercy for graceful operations on workers is 90 seconds Aug 29 19:06:50.114817 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 19:06:50.114817 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: *** Operational MODE: preforking *** Aug 29 19:06:50.115027 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: *** uWSGI is running in multiple interpreter mode *** Aug 29 19:06:50.115027 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: spawned uWSGI master process (pid: 115950) Aug 29 19:06:50.115259 dv-cinder-731261-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 19:06:50.117356 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: spawned uWSGI worker 1 (pid: 115967, cores: 1) Aug 29 19:06:50.117356 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: spawned uWSGI worker 2 (pid: 115968, cores: 1) Aug 29 19:06:50.117356 dv-cinder-731261-6-iscsi devstack@n-api.service[115950]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 19:06:50.783455 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 19:06:50.794144 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 19:06:51.944796 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:06:51.944796 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: from cryptography.utils import int_from_bytes Aug 29 19:06:51.945422 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:06:51.945422 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: from cryptography.utils import int_from_bytes Aug 29 19:06:51.977123 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:06:51.977123 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: from cryptography.utils import int_from_bytes Aug 29 19:06:51.977715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 19:06:51.977715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: from cryptography.utils import int_from_bytes Aug 29 19:06:54.397118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 19:06:54.397706 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 19:06:54.397938 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 19:06:54.398292 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 19:06:54.398560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 19:06:54.398959 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.399328 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.399658 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.399987 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.400494 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.400893 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.401148 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.401472 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.402064 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.402332 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.402660 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.402985 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-731261-6-iscsi {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.403362 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.403660 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.403979 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.404306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.404612 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.404943 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.405251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.405762 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.406216 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.406532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.406847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.407218 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.407540 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.407852 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.408183 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.408492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.408826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.409142 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.409553 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-731261-6-iscsi {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.410566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.410926 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.411286 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.411719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.412040 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.412353 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.412678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.413007 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.413324 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.413653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.413981 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.414307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.414627 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.414934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.415287 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.415606 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.415930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.416240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.416556 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.416811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.417127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.417453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.417776 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.418104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.418361 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.418615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.418936 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.419292 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.419608 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.419919 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.420231 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.420544 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.420853 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.421163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.421472 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.421784 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.422107 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.422426 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.422752 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.423063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.423408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.423846 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.424102 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.424414 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.424761 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.425082 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.425480 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.425942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.426289 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.426592 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.426903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.427443 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.427772 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.428100 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.428413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.428671 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.428979 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.429290 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.429612 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.429921 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.430232 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.430542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.431322 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.431322 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.431527 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.431792 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.432092 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.432400 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.432708 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.433023 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.433335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.433639 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.433966 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.434289 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.434596 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.434904 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.435238 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.435550 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.435873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.436179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.436487 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.436812 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.437122 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.437427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.437748 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.438060 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.438371 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.438690 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.438993 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.439331 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.439654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.439965 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.440274 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.440577 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.440886 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.441227 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.441537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.441843 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.442233 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.442565 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.442891 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.443486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.443663 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.443885 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.444191 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.444514 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.444855 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.445187 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.445531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.445845 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.446179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.446511 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.446829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.447178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.447502 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.447827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.448140 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.448452 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.448765 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.449086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.449408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.449739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.450059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.450380 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.450705 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.451031 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.451387 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.451702 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.452029 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.452343 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.452692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.453048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.453366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.453690 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.454021 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.454333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.454645 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.454955 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.455495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.456012 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.456498 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.457539 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.457978 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.458311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.458627 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.458945 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.459293 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.459611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.459928 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.460276 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.460594 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.460920 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.461254 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.461561 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.461885 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.462199 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.463265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.463265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.463265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.463542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.466873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.466873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.466873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.466873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.466873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.466873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.466873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.466873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.467603 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.467603 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.467603 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.467603 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.467603 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.468174 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.468174 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.468342 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.468614 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.468912 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.469246 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.469555 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.469866 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.470185 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.470502 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.470815 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.471159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.471479 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.472096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.472096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.472984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.472984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.473875 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.474003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.474297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.474628 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.474940 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.475272 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.475586 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.475894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.476203 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.476692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.476793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.477120 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.477602 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.477700 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.478077 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.478264 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.478589 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.478902 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.479237 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.479545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.479853 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.480232 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.480494 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.480841 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.481181 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.481505 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.481847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.482147 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.482387 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 19:06:54.482801 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.482887 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 19:06:54.482969 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.483099 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.483197 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 19:06:54.483428 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.483556 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 19:06:54.483739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.483838 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 19:06:54.484067 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.484184 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.484383 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.484517 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.484708 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.484845 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.485029 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.485159 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.485355 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.485627 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.485724 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.485946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.486042 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.486274 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.486378 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.486591 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.486688 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.486924 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.487025 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.487218 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.487326 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.487541 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.487641 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.487933 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.488034 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-731261-6-iscsi {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.488262 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.488417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.488567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.488740 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.488877 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.489064 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.489174 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.489393 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.489491 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.489710 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.489825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.490037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.490163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.490348 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.490439 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.490701 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.490857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.491010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.491199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.491373 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.491515 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.491688 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.491857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.492009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.492162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.492315 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.492484 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.492636 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.492799 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.492966 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.493126 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.493299 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.493442 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.493612 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.493756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.493927 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.494072 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.494249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.494475 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-731261-6-iscsi {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.494573 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.494799 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.494891 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.495148 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.495276 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.495472 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.495578 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.495777 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.495883 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.496088 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.496193 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.496405 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.496512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.496715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.496811 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.497027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.497131 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.497333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.497439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.497646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.497742 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.497954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.498058 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.498261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.498374 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.498567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.498690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.498977 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.499158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.499317 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.499475 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.499625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.500504 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.500673 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.500844 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.501015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.501159 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.501311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.501455 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.501605 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.501756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.501908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.502052 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.502201 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.502352 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.503160 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.503812 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.504061 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.504312 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.504543 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.504962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.504962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.505273 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.505418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.505560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.505710 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.505853 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.506004 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.506164 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.506164 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.506410 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.506497 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.506588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.506680 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.506762 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.506851 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.506934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.507015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.507015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.507015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.507015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.507352 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.507441 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.507530 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.507619 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.507711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.507793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.507883 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.507965 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.507965 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.508169 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.508263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.508343 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.508420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.508503 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.508576 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.508652 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.508731 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.508931 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.94 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.509024 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.509195 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.94 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.509311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.509539 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.509892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.509991 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.510218 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.510315 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.510533 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.510633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.510853 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.510952 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.511408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.511529 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.511631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.511729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.511869 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.512018 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.512186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.512286 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.512502 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.512634 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.512813 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.512939 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.513119 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.513218 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.513406 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.513556 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.513701 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.513851 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.514001 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.514143 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.514307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.514425 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.514615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.514712 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.514923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.515025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.515256 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.515375 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.515562 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.515669 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.515868 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.515964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.516175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.516318 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.516482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.516622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.516824 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.516967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.517115 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.517262 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.517401 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.517619 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.517763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.517903 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.518052 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.518190 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.518328 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.518495 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.518644 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.518792 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.518944 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.519612 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.519804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.520022 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.520245 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.520409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.520559 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.520700 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.520855 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.520995 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.521290 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.521394 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.521493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.521575 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.521802 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.521901 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.522112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.522214 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.522429 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.522530 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.522738 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.522851 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.523058 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.523196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.523396 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.523489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.523707 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.523798 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.524016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.524120 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.524317 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.524408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.524628 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.524726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.524944 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.525061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.525250 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.525375 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.525554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.525658 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.525859 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.525969 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.526160 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.526265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.526461 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.526832 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.527032 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.527171 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.527368 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.527460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.527670 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.527768 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.527971 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.528072 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.528280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.528378 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.528593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.528714 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.528898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.528997 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.529201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.529296 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.529504 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.529613 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.529828 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 19:06:54.529932 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.530122 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.530284 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.530423 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.530575 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.530723 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.530863 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.531010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.531182 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.531337 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.531510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.531654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.531839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.531984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.532156 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.532304 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.532468 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.532602 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.532781 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.532915 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.533102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.533259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.533408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.533567 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.533709 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.533844 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.533983 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.534134 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.534299 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.534435 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.534612 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.534801 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.536045 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.536166 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.536243 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.536313 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.536390 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.536473 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.537490 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.537603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.537688 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.537767 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.537845 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.537845 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.537994 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.538074 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.538155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.538318 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.538453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.538646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.538770 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.538956 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.539329 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.539490 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.539647 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.539802 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.539954 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.540096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.540246 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.540388 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.540541 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.540691 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.540835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.540984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.541127 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.541307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.541460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.541617 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.541760 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.541910 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.542053 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.542226 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.542386 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.542547 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.542698 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.542839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.542982 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.543192 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.543353 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.543505 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.543656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.543798 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.543948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.544091 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.544246 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.544399 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.544541 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.544689 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.544830 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.544978 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.545134 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.545277 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.545419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.545560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.545720 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.546210 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.546383 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.546529 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.546683 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.546824 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.546973 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.547144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.547306 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.547448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.547596 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.547746 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.547895 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.548120 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.548267 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.548410 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.548550 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.548714 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.548857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.549013 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.549156 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.549305 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.549455 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.549604 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.549745 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.549895 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.550036 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.550200 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.550384 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.550539 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.550781 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.551184 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.551432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.551595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.551747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.551898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.552051 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.552194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.552338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.552488 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.552638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.552789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.552956 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.553122 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.553269 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.553412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.553554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.553696 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.553696 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.553981 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.554130 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.554279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.554445 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.554598 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.554598 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.554895 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.555060 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.556344 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.556505 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.556667 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.556812 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.556954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.557098 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.557246 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.557396 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.557552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.557705 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.557848 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.558002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.558144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.558294 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.558450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.558594 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.558736 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.558877 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.559018 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.559205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.559358 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.559508 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.559651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.559813 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.559965 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.560123 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.560274 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.560417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.560566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.560709 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.560851 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.561006 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.561156 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.561306 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.561449 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.561591 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.561750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.561904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.562097 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.562255 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.562398 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.562546 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.562698 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.562849 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.562849 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.563158 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.563307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.563460 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.563460 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.563758 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.563758 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.564050 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.564201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.564343 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.564497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.564640 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.564790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.564932 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.565082 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.565225 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.565380 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.565524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.565676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.565824 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.566025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.566712 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.566925 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.567105 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.567255 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.567398 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.567398 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.567693 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.567854 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.567854 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.568128 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.568316 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.568475 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.568635 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.568788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.568930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.569079 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.569230 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.569372 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.569529 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.569680 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.569831 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.569974 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.570134 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.570629 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.570788 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.570939 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.571110 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.571272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.571416 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.571574 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.571717 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.571868 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.572018 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.572018 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.572306 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.572468 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.572620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.572762 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.572904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.573045 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.573187 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.573342 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.573494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.573643 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.573785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.573927 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.574116 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.574261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.574423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.574574 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.574726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.574879 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.575044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.575229 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.575380 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.575524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.575673 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.575815 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.575972 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.576116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.576258 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.576682 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.576906 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.577054 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.577207 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.577350 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.577493 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.577642 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.577786 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.577928 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.578080 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.578231 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.578374 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.578533 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.578677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.578832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.578832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.579136 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.579296 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.579453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.579605 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.579757 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.579907 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.580049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.580201 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.580344 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.580505 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.580701 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.580863 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.581011 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.581160 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.581302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.581445 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.582210 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.582435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.582662 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.582912 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.583193 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.584063 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.584218 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.584371 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.584523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.584675 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.584829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.584829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.585104 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.585247 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.585398 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.585549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.585701 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.585844 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.585999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.586149 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.586291 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.586440 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.586829 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.587096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.587250 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.587401 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.587552 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.587705 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.587848 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.587999 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.588153 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.588296 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.588437 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.588592 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.588744 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.588894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.589045 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.589187 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.589337 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.589488 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.589631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.589773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.589922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.590081 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.590256 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.590489 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.590637 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.590794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.590942 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.591115 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.591278 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.591430 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.591581 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.591730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.591873 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.592023 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.592192 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.592192 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.592464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.592606 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.592755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.592904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.593056 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.593214 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.593357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.593498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.593640 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.593781 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.593936 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.594096 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.594238 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.594381 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.594381 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.594658 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.594809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.594967 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.595199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.595357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.595508 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.595659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.595802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.595960 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.596103 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.596252 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.596396 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.596551 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.596720 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.597089 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.597880 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.598117 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.598349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.598590 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.598780 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.598925 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.598925 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.599278 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.599437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.599583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.599725 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.599867 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.600008 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.600156 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.600308 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.600459 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.600603 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.600751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.600911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.601063 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.601214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.601361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.601511 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.601665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.601816 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.601959 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.602101 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.602101 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.602379 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.602535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.602691 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.602833 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.602975 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.603182 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.603345 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.603496 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.603638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.603638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.603917 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.604059 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.604214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.604358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.604507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.604670 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.604815 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.604964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.605117 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.605261 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.605448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.605593 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.605741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.605896 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.606047 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.606189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.606331 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.606483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.606633 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.606791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.607176 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.607364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.607364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.607711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.607893 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.608058 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.608201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.608343 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.608492 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.608634 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.608788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.608940 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.609084 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.609225 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.609366 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.609522 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.609677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.609827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.609977 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.610120 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.610298 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.610454 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.610598 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.610761 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.610904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.611056 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.611304 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.611456 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.611607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.611750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.611892 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.612041 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.612041 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.612339 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.612339 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.612634 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.612777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.612977 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.613237 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.613237 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.613713 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.613869 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.614019 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.614163 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.614322 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.614473 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.614616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.614766 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.614920 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.615109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.615261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.615416 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.615568 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.615719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.615870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.616026 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.616177 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.616322 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.616471 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.616615 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.616758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.616758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.617284 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.617450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.617619 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.617845 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.617994 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.618145 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.618296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.618450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.618600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.618742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.618742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.619027 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.619201 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.619355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.619355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.619635 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.619787 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.619928 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.619928 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.620205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.620347 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.620489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.620652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.620806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.620967 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.621111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.621252 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.621400 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.621552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.621695 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.621838 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.621979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.622121 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.622272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.622422 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.622565 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.622707 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.622862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.623004 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.623201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.623364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.623507 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.623649 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.623791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.623931 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.624100 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.624826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.624981 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.625132 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.625274 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.625428 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.625582 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.625734 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.625885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.626029 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.626171 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.626322 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.626473 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.626616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.626758 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.626908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.627051 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.627490 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.627670 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.627842 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.628067 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.628214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.628365 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.628365 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.628840 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.629017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.629292 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.629457 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.629617 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.629782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.629947 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.630106 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.630265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.630423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.630583 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.630745 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.630895 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.631045 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.631291 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.631444 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.631602 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.631762 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.631911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.632073 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.632232 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.632382 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.632540 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.632690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.632847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.632847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.632847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.633291 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.633453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.633453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.633757 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.633914 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.634074 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.634240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.634398 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.634549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.634698 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.634847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.634996 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.635190 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.635353 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.635504 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.635653 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.635809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.635979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.636140 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.636292 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.636441 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.636589 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.636738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.636894 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.637057 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.637208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.637358 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.637788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.637945 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.638206 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.638376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.638527 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.638677 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.638827 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.638975 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.639194 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.639351 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.639508 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.639666 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.639826 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.639974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.640136 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.640293 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.640454 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.640454 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.640766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.640927 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.641076 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.641226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.641383 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.641542 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.641691 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.641918 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.642071 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.642222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.642382 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.642533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.642682 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.642841 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.642999 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.643184 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.643335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.643485 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.643634 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.643792 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.643949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.644859 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.645071 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.645249 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.645438 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.645635 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.645801 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.645960 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.646110 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.646265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.646434 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.646584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.646734 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.646883 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.647039 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.647236 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.647401 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.647559 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.647961 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.647961 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.648352 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.648520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.648671 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.648820 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.648968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.649117 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.649274 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.649433 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.649601 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.649752 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.649910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.650060 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.650217 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.650376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.650536 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.650693 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.650693 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.650986 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.651170 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.651347 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.651502 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.651921 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.652080 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.652237 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.652395 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.652553 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.652711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.652861 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.653010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.653173 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.653332 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.653490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.653639 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.653795 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.653968 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.653968 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.654269 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.654427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.654584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.654741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.654890 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.655046 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.655232 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.655384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.655534 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.655690 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.655856 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.656025 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.656175 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.656324 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.656479 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.656637 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.656793 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.656952 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.657102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.657251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.657400 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.657548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.657697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.658351 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.658588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.658588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.658898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.658898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.659295 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.659793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.660473 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.660835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.661009 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.661301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.661469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.661655 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.661816 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.661969 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.662180 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.662350 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.662520 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.662678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.662835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.662984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.663210 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.663367 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.663529 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.663687 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.663855 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.664006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.664155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.664317 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.664476 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.664628 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.664785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.664942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.665092 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.665249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.665400 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.665556 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.665724 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.665724 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666172 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666330 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666630 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666630 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666630 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666630 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666630 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666630 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666630 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.666630 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.667890 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.667890 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.667890 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.668776 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.668936 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.669094 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.669258 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.669456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.669619 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.669619 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.669904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670381 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670539 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670689 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 19:06:54.670840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.670840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.672085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.672085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.672085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.672085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.672085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.672085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.672085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.672085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.673341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.673341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.673341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.673341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.673341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.673341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.673341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.673341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.674609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.674609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.674609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.674609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.674609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.674609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.675712 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.675712 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.675712 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.676344 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.676344 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.676766 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.677086 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.677522 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.677845 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.678443 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.678622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.679039 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.679385 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.679708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.680029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.680356 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.680776 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.681091 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.681413 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.681734 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.682055 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.682622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.682959 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.683313 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.683631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.683947 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.684264 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.685967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.686309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.686640 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.686968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.687320 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.687665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.687999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.688610 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.688792 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.689050 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.689335 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.689669 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.689974 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.690339 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.690714 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.691588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.691858 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.692158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.692486 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.692809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.693219 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.693550 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.693867 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.694187 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.694503 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.694824 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.695214 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.695526 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.695866 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.696192 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.696509 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.696827 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.697149 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.697692 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.698010 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.698344 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.698779 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.698980 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.699348 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.699669 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.700001 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.700309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.700614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.701604 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.701604 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.701604 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.702165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.702165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.702463 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.702737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.703047 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.703692 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.704049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.704373 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.704705 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.705036 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.705356 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.705737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.705997 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.706309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.707181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.707553 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.707866 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.708175 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.708483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.708920 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.709186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.709496 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.709809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.710118 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.710447 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.710765 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.711085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.711398 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.711744 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.712005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.712308 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.712620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.712928 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.713242 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.713547 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.713857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.714164 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.714478 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.714784 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.715122 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.715479 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.715875 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.716109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.716414 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.716734 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.717046 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.717370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.717684 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.717999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.718344 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.718776 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.719331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.719683 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.720007 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.720342 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.720680 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.720987 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.721294 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.721599 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.721937 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.722882 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.723174 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.723493 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.723829 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.724115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.724535 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.724852 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.725165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.725476 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.726219 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.726219 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.726544 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.726708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.726981 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.727319 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.727486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO dbcounter [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Registered counter for database nova_api Aug 29 19:06:54.727657 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.727973 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.728290 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.728606 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.728925 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.729250 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.729544 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.729842 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.730149 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.730464 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.730798 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.731132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.731442 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.731872 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.732215 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.732548 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.732875 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.733186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.733507 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.733827 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.734138 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.734458 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.734771 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.735121 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.735472 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.735802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.736126 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.737051 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.737051 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.737051 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.737506 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.737668 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.738508 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.739010 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.739477 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.739477 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.739846 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.740237 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.740484 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.740795 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.741110 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.741420 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.741727 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.742033 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.742421 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.742711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.742922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.744276 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.744276 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.744276 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.744775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.744926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.745109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.745454 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.745790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.746107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.746433 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.746750 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.747135 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.747430 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.747753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.748075 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.748398 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.748708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.748873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:06:54.749109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.749417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.749785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.749936 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.750293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.750546 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.750857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.751387 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.751559 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.751862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.752186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.752614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.752927 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.753107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.753412 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.754460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.754721 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.754986 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.755291 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.755677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.756022 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.756344 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.756604 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writer thread running {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:06:54.756710 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.756966 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.757288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.757605 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.757933 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.758256 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.758567 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.758891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.759318 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.759674 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.759990 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.760334 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.760660 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.760976 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.761294 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.761598 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 19:06:54.761842 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 19:06:54.813178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.context [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85f87a18-97fd-4459-bb91-024e0266a783(cell1) {{(pid=115968) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 19:06:54.817268 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:54.817750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:54.819364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:54.820102 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:54.820539 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:54.822515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:54.824385 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO dbcounter [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Registered counter for database nova_api Aug 29 19:06:54.824519 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO dbcounter [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Registered counter for database nova_cell0 Aug 29 19:06:54.828598 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO dbcounter [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Registered counter for database nova_cell1 Aug 29 19:06:54.838035 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:06:54.841118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:06:54.844696 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writer thread running {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:06:54.848188 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_db.sqlalchemy.engines [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115967) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:06:54.855682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writer thread running {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:06:54.914415 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.context [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),85f87a18-97fd-4459-bb91-024e0266a783(cell1) {{(pid=115967) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 19:06:54.918664 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:54.919179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:54.920772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:54.923554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:06:54.923554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:06:54.923975 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:06:54.926599 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO dbcounter [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Registered counter for database nova_cell0 Aug 29 19:06:54.930976 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO dbcounter [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Registered counter for database nova_cell1 Aug 29 19:06:54.938543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_db.sqlalchemy.engines [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115967) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:06:54.941226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_db.sqlalchemy.engines [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115967) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:06:54.949993 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writer thread running {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:06:54.950501 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writer thread running {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:06:54.991050 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writer thread running {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:06:55.001057 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO dbcounter [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Registered counter for database nova_cell0 Aug 29 19:06:55.007788 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_db.sqlalchemy.engines [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:06:55.012291 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writer thread running {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:06:55.101960 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO dbcounter [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Registered counter for database nova_cell0 Aug 29 19:06:55.110786 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_db.sqlalchemy.engines [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115967) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 19:06:55.116336 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writer thread running {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 19:06:55.337063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: WARNING keystonemiddleware.auth_token [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:06:55.344363 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: WARNING keystonemiddleware.auth_token [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:06:55.443030 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: WARNING keystonemiddleware.auth_token [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:06:55.450525 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: WARNING keystonemiddleware.auth_token [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:06:55.695386 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: WARNING keystonemiddleware.auth_token [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:06:55.702289 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: WARNING keystonemiddleware.auth_token [None req-f1f432e9-35d1-437e-995a-ff512bd5dff3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:06:55.708751 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b497dbb9c0 pid: 115968 (default app) Aug 29 19:06:55.804411 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: WARNING keystonemiddleware.auth_token [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 19:06:55.810489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: WARNING keystonemiddleware.auth_token [None req-10d11938-8963-4ea1-9994-7e16df9c0afe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 19:06:55.815952 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b497dbb9c0 pid: 115967 (default app) Aug 29 19:07:48.711707 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=3 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:48.712668 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=3 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:48.713499 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=3 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:48.714240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=3 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:48.835588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=3 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:48.844537 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=3 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:48.845691 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=3 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:48.853020 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=3 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:07:50.119137 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-adf05eba-96c3-4296-b77a-684d2dcc544e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Action: 'create', calling method: .version_select at 0x7f3d773c9e50>, body: {"keypair": {"name": "tempest-keypair-1693102324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKE+X6zvYDovguh7uiGG12uV1uh2lKcm3NY9bnKXfi+VBtr8IO7TBM5uiwXUvNFkACr+osODCAJQ1iN+cqrm3GPGJS1IhBJ//hZY7Gg2Y9NAD944OJxmYwAsuC9hucCuA=="}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:07:50.249373 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-adf05eba-96c3-4296-b77a-684d2dcc544e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Getting quotas for project 5dda60c835244f5f9c980ed1927d9784. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:07:50.268257 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-adf05eba-96c3-4296-b77a-684d2dcc544e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Getting quotas for user 624a0a90866446439918bd65ce5ddc60 and project 5dda60c835244f5f9c980ed1927d9784. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:07:50.274331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1237451565", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:07:50.447426 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-adf05eba-96c3-4296-b77a-684d2dcc544e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.741002 Aug 29 19:07:50.450758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 1/1] 10.222.0.94 () {60 vars in 1159 bytes} [Mon Aug 29 19:07:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:07:51.551753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] validate_networks() for [('9853bcbc-2750-4a4b-ae35-877c673fbf89', None, None, None, None, None)] {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:07:53.264079 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ccd43fe0-1f17-4569-b266-b803c387f283 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Action: 'create', calling method: .version_select at 0x7f3d7725b430>, body: {"keypair": {"name": "tempest-keypair-457457575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPWr/7Rqj6DENLirnYfn/1ZIE18oorlOF0CZh5IJvnl9hWaQCDk8xWPvy5LO5b0mZSP1EWbQjPzSjg4uoAQYdUhRF22X2ePq27F6aWkdH9BbJjG9Go/FrhAlHh1DvgptzQ=="}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:07:53.318274 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-ccd43fe0-1f17-4569-b266-b803c387f283 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Getting quotas for project 6f6085f7a1df49ae8e2375e28d7d6792. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:07:53.335049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-ccd43fe0-1f17-4569-b266-b803c387f283 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Getting quotas for user ff8ce50a95b742a48500e634db50fb36 and project 6f6085f7a1df49ae8e2375e28d7d6792. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:07:53.388727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ccd43fe0-1f17-4569-b266-b803c387f283 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.496004 Aug 29 19:07:53.390952 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 2/2] 10.222.0.94 () {62 vars in 1200 bytes} [Mon Aug 29 19:07:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 499 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 29 19:07:54.015493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-284594856", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "networks": [{"uuid": "fca34072-56a5-4db2-b6ce-2bbddd357288"}]}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:07:54.156063 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:07:54.156499 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:07:54.157748 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:07:54.158186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:07:54.158617 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:07:54.189487 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:54.190196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:54.190945 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:54.192350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:54.193105 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:54.193977 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:54.229863 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Getting quotas for project b429eb37f4ed408d830ef2c1034e9bdc. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:07:54.239270 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Getting quotas for user 73c4a7ab7fc7425389843798faa25372 and project b429eb37f4ed408d830ef2c1034e9bdc. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:07:54.255809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:07:54.259025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:07:54.379432 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.network.neutron [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] validate_networks() for [('fca34072-56a5-4db2-b6ce-2bbddd357288', None, None, None, None, None)] {{(pid=115968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:07:54.408302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8b1c7d06-0040-47d1-b8fe-0332e016d45a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.583835 Aug 29 19:07:54.408998 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 1/3] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:07:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 5588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 19:07:54.572314 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1efe84aa-817a-4ceb-991e-5dbc89a95060 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: .version_select at 0x7f3d7697eca0>, body: {"keypair": {"name": "tempest-keypair-1260835233", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMc4rhuCKsq5fqknXUuuCq/nbxetpx47yhmuA+2mfesS794uQBI8bDoC8LFvO/NUGZK7OoUd8I+WnBRLDfWV226tCuuWdz96Zorn6GdKdsUZSSeDUw+eJY0i7HL9aCWodg=="}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:07:54.672630 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-1efe84aa-817a-4ceb-991e-5dbc89a95060 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for project b967c22662da47aeb9292704c39b44bb. Resources: {'key_pairs'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:07:54.690520 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-1efe84aa-817a-4ceb-991e-5dbc89a95060 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for user ac0bc9e010d044a5a2147010cbdb4d85 and project b967c22662da47aeb9292704c39b44bb. Resources: {'key_pairs'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:07:54.761277 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1efe84aa-817a-4ceb-991e-5dbc89a95060 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.350934 Aug 29 19:07:54.762027 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 2/4] 10.222.0.94 () {60 vars in 1159 bytes} [Mon Aug 29 19:07:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:07:54.770315 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1e2b1de4-d230-4239-87ee-85da2150df1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:54.770543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1e2b1de4-d230-4239-87ee-85da2150df1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:55.112499 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1e2b1de4-d230-4239-87ee-85da2150df1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:55.150739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1e2b1de4-d230-4239-87ee-85da2150df1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1222 microversion: 2.1 time: 0.387649 Aug 29 19:07:55.156256 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 3/5] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:54 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1222 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:55.503429 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-133742581", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:07:55.624739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] validate_networks() for [('9853bcbc-2750-4a4b-ae35-877c673fbf89', None, None, None, None, None)] {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:07:56.117588 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Flavor limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:07:56.118163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Image limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:07:56.118683 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Flavor pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:07:56.119092 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Image pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:07:56.119581 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:07:56.151540 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:56.152072 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:56.161926 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:56.164310 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:56.169181 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:56.169734 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:56.264077 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Getting quotas for project 74f3f1161ef84f30bbd787e9361a0dac. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:07:56.277101 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Getting quotas for user cc580d348f154c4488a5f84640539655 and project 74f3f1161ef84f30bbd787e9361a0dac. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:07:56.313455 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Going to run 1 instances... {{(pid=115968) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:07:56.321622 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:07:56.563461 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7469f9c9-78f9-48b8-a4f7-c46f1b0d1319 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.625767 Aug 29 19:07:56.568184 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 3/6] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:07:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 2636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 19:07:56.588854 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b415e599-9b13-497c-b452-fd1f878d0fa1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:56.591746 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b415e599-9b13-497c-b452-fd1f878d0fa1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:56.919629 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b415e599-9b13-497c-b452-fd1f878d0fa1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:56.959251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b415e599-9b13-497c-b452-fd1f878d0fa1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1214 microversion: 2.1 time: 0.382925 Aug 29 19:07:56.979604 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 4/7] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:56 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1214 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:57.100569 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:07:57.109259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:07:57.109259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:07:57.109259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:07:57.109259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:07:57.156176 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:57.156722 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:57.157418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:57.158449 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:57.162705 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:57.165488 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:57.222111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Getting quotas for project b429eb37f4ed408d830ef2c1034e9bdc. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:07:57.233685 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Getting quotas for user 73c4a7ab7fc7425389843798faa25372 and project b429eb37f4ed408d830ef2c1034e9bdc. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:07:57.274861 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:07:57.289310 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:07:57.467035 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8d9e3545-7338-4eed-a579-cb54a5136e7e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.967386 Aug 29 19:07:57.469563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 4/8] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:07:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 19:07:57.481763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-29618fca-fb87-4f14-bbe0-e06b48178992 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:57.482866 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-29618fca-fb87-4f14-bbe0-e06b48178992 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:57.683310 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-29618fca-fb87-4f14-bbe0-e06b48178992 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:57.704451 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-29618fca-fb87-4f14-bbe0-e06b48178992 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1221 microversion: 2.1 time: 0.225077 Aug 29 19:07:57.708080 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 5/9] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:57 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1221 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:57.983824 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b0bd6c28-3d60-4f2d-8eb9-bf147841ba16 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:57.984902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b0bd6c28-3d60-4f2d-8eb9-bf147841ba16 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:58.133075 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b0bd6c28-3d60-4f2d-8eb9-bf147841ba16 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:58.141685 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b0bd6c28-3d60-4f2d-8eb9-bf147841ba16 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1214 microversion: 2.1 time: 0.165282 Aug 29 19:07:58.148945 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 5/10] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:57 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1214 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:58.734771 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7c9af74e-4410-4aad-a1be-02f1327994d3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:58.736873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7c9af74e-4410-4aad-a1be-02f1327994d3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:58.788731 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7c9af74e-4410-4aad-a1be-02f1327994d3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:58.789260 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7c9af74e-4410-4aad-a1be-02f1327994d3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:58.789742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7c9af74e-4410-4aad-a1be-02f1327994d3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:58.790730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7c9af74e-4410-4aad-a1be-02f1327994d3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:58.793643 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7c9af74e-4410-4aad-a1be-02f1327994d3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:58.794120 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7c9af74e-4410-4aad-a1be-02f1327994d3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:59.143564 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7c9af74e-4410-4aad-a1be-02f1327994d3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:59.169928 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fe58c506-2a51-448c-9652-e63131455674 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:07:59.170498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fe58c506-2a51-448c-9652-e63131455674 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:07:59.177212 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7c9af74e-4410-4aad-a1be-02f1327994d3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1225 microversion: 2.1 time: 0.447718 Aug 29 19:07:59.199317 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe58c506-2a51-448c-9652-e63131455674 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:59.199827 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe58c506-2a51-448c-9652-e63131455674 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:59.199978 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 6/11] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:58 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1225 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:59.200270 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe58c506-2a51-448c-9652-e63131455674 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:59.200994 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe58c506-2a51-448c-9652-e63131455674 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:07:59.201457 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe58c506-2a51-448c-9652-e63131455674 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:07:59.201885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe58c506-2a51-448c-9652-e63131455674 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:07:59.467225 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fe58c506-2a51-448c-9652-e63131455674 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:07:59.495161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fe58c506-2a51-448c-9652-e63131455674 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1218 microversion: 2.1 time: 0.328882 Aug 29 19:07:59.508791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 6/12] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:07:59 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1218 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:07:59.636860 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1457352257", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72f0c062-bae6-4f61-bab2-9380409ee0e3"}], "security_groups": [{"name": "tempest-securitygroup--1798518892"}], "key_name": "tempest-keypair-1693102324", "user_data": "}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:07:59.911207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.network.neutron [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] validate_networks() for [('72f0c062-bae6-4f61-bab2-9380409ee0e3', None, None, None, None, None)] {{(pid=115968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:08:00.086234 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-669834872", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4625722-be90-4944-a2a2-5603ab9cea5a"}], "security_groups": [{"name": "tempest-securitygroup--1557247666"}], "key_name": "tempest-keypair-457457575", "user_data": "}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:00.335678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] validate_networks() for [('b4625722-be90-4944-a2a2-5603ab9cea5a', None, None, None, None, None)] {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:08:00.970521 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Flavor limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:08:00.976472 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Image limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:08:00.976991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Flavor pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:08:00.977415 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Image pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:08:00.977848 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:08:01.016077 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:01.016588 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:01.017423 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:01.017754 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:01.018213 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:01.018639 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:01.055044 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Getting quotas for project 5dda60c835244f5f9c980ed1927d9784. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:08:01.062936 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Getting quotas for user 624a0a90866446439918bd65ce5ddc60 and project 5dda60c835244f5f9c980ed1927d9784. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:08:01.079205 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Going to run 1 instances... {{(pid=115968) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:08:01.082495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:08:01.084110 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:08:01.084669 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:08:01.085330 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:08:01.085545 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:08:01.086145 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:08:01.095028 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:01.095549 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:01.096154 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:01.096888 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:01.097852 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:01.098357 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:01.117702 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Getting quotas for project 6f6085f7a1df49ae8e2375e28d7d6792. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:08:01.123892 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Getting quotas for user ff8ce50a95b742a48500e634db50fb36 and project 6f6085f7a1df49ae8e2375e28d7d6792. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:08:01.140410 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:08:01.145409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:08:01.145866 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8f50834c-5180-4c99-a7db-2b344e8f4ab0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.519955 Aug 29 19:08:01.147189 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 7/13] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:07:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:08:01.152392 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f3263fcd-d9eb-4c1d-aa97-7b01a318298c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:01.153023 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f3263fcd-d9eb-4c1d-aa97-7b01a318298c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:01.161226 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3263fcd-d9eb-4c1d-aa97-7b01a318298c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:01.161940 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3263fcd-d9eb-4c1d-aa97-7b01a318298c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:01.162366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3263fcd-d9eb-4c1d-aa97-7b01a318298c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:01.163370 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3263fcd-d9eb-4c1d-aa97-7b01a318298c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:01.163867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3263fcd-d9eb-4c1d-aa97-7b01a318298c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:01.164306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3263fcd-d9eb-4c1d-aa97-7b01a318298c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:01.233553 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a34e41bf-6e31-4042-835f-fac57a3a2ae8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.152352 Aug 29 19:08:01.235168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 7/14] 10.222.0.94 () {62 vars in 1188 bytes} [Mon Aug 29 19:08:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 19:08:01.242244 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-25ee1ccd-49e9-41af-976b-891d322a62b1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:01.243239 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-25ee1ccd-49e9-41af-976b-891d322a62b1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:01.249071 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f3263fcd-d9eb-4c1d-aa97-7b01a318298c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:01.251670 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-25ee1ccd-49e9-41af-976b-891d322a62b1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:01.252170 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-25ee1ccd-49e9-41af-976b-891d322a62b1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:01.252919 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-25ee1ccd-49e9-41af-976b-891d322a62b1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:01.254932 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-25ee1ccd-49e9-41af-976b-891d322a62b1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:01.255771 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-25ee1ccd-49e9-41af-976b-891d322a62b1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:01.256445 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-25ee1ccd-49e9-41af-976b-891d322a62b1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:01.258106 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f3263fcd-d9eb-4c1d-aa97-7b01a318298c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1217 microversion: 2.1 time: 0.109785 Aug 29 19:08:01.258851 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 8/15] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:01 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:01.267114 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1356644761", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "117b2cb0-1215-4254-9d1f-c2728d00a788"}], "security_groups": [{"name": "tempest-securitygroup--1077242416"}], "key_name": "tempest-keypair-1260835233", "user_data": "}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:01.367466 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-25ee1ccd-49e9-41af-976b-891d322a62b1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:01.380886 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-25ee1ccd-49e9-41af-976b-891d322a62b1 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1210 microversion: 2.1 time: 0.144220 Aug 29 19:08:01.405942 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 8/16] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:01 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1210 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:01.474413 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fe477cf5-e736-4b97-b248-21901e9bae7d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:01.475862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fe477cf5-e736-4b97-b248-21901e9bae7d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:01.622698 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.network.neutron [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] validate_networks() for [('117b2cb0-1215-4254-9d1f-c2728d00a788', None, None, None, None, None)] {{(pid=115968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:08:01.715277 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fe477cf5-e736-4b97-b248-21901e9bae7d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:01.760189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fe477cf5-e736-4b97-b248-21901e9bae7d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1238 microversion: 2.1 time: 0.350169 Aug 29 19:08:01.761476 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 9/17] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:01 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1238 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:01.766835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f9576586-b3ac-4f88-92a4-b913bdebd229 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:01.767556 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f9576586-b3ac-4f88-92a4-b913bdebd229 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:01.982572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f9576586-b3ac-4f88-92a4-b913bdebd229 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:01.998717 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f9576586-b3ac-4f88-92a4-b913bdebd229 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:02.002755 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f9576586-b3ac-4f88-92a4-b913bdebd229 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:02.008752 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f9576586-b3ac-4f88-92a4-b913bdebd229 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1280 microversion: 2.20 time: 0.245688 Aug 29 19:08:02.009197 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 10/18] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:01 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1280 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:02.291976 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-31d4cc20-2583-42ca-aa39-c200a2448ee9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:02.292824 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-31d4cc20-2583-42ca-aa39-c200a2448ee9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:02.310968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31d4cc20-2583-42ca-aa39-c200a2448ee9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:02.317971 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31d4cc20-2583-42ca-aa39-c200a2448ee9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:02.318805 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31d4cc20-2583-42ca-aa39-c200a2448ee9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:02.320353 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31d4cc20-2583-42ca-aa39-c200a2448ee9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:02.321053 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31d4cc20-2583-42ca-aa39-c200a2448ee9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:02.321707 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31d4cc20-2583-42ca-aa39-c200a2448ee9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:02.468537 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-31d4cc20-2583-42ca-aa39-c200a2448ee9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:02.479439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-31d4cc20-2583-42ca-aa39-c200a2448ee9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1217 microversion: 2.1 time: 0.190878 Aug 29 19:08:02.480250 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 11/19] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:02 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1217 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:02.497307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ecd7f9df-bed0-4ec6-bf45-89fb2f6c67b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:02.498568 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ecd7f9df-bed0-4ec6-bf45-89fb2f6c67b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:02.507548 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ecd7f9df-bed0-4ec6-bf45-89fb2f6c67b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:02.508431 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ecd7f9df-bed0-4ec6-bf45-89fb2f6c67b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:02.511635 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ecd7f9df-bed0-4ec6-bf45-89fb2f6c67b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:02.512474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ecd7f9df-bed0-4ec6-bf45-89fb2f6c67b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:02.513198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ecd7f9df-bed0-4ec6-bf45-89fb2f6c67b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:02.513788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ecd7f9df-bed0-4ec6-bf45-89fb2f6c67b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:02.586274 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Flavor limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:08:02.586745 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Image limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:08:02.587531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Flavor pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:08:02.587961 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Image pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:08:02.588381 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:08:02.604018 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:02.604517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:02.604958 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:02.605694 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:02.609336 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:02.611418 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:02.620941 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ecd7f9df-bed0-4ec6-bf45-89fb2f6c67b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:02.629791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ecd7f9df-bed0-4ec6-bf45-89fb2f6c67b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1210 microversion: 2.1 time: 0.147826 Aug 29 19:08:02.631387 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 12/20] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:02 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1210 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:02.653094 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for project b967c22662da47aeb9292704c39b44bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:08:02.657590 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for user ac0bc9e010d044a5a2147010cbdb4d85 and project b967c22662da47aeb9292704c39b44bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:08:02.677097 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Going to run 1 instances... {{(pid=115968) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:08:02.679338 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:08:02.765692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c4ff3b9d-15e9-4a47-b00c-5956c894a404 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.505394 Aug 29 19:08:02.766430 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 9/21] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:08:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:08:02.778428 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3dd71677-ee3a-46a9-8825-e0b6f5a13d8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:02.779417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3dd71677-ee3a-46a9-8825-e0b6f5a13d8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:02.782984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3c14db12-597b-460f-b87d-4a06e0ef5a78 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:02.783687 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3c14db12-597b-460f-b87d-4a06e0ef5a78 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:02.793857 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c14db12-597b-460f-b87d-4a06e0ef5a78 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:02.794361 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c14db12-597b-460f-b87d-4a06e0ef5a78 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:02.794807 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c14db12-597b-460f-b87d-4a06e0ef5a78 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:02.795552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c14db12-597b-460f-b87d-4a06e0ef5a78 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:02.796011 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c14db12-597b-460f-b87d-4a06e0ef5a78 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:02.796443 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c14db12-597b-460f-b87d-4a06e0ef5a78 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:02.890977 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3dd71677-ee3a-46a9-8825-e0b6f5a13d8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:02.899866 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3dd71677-ee3a-46a9-8825-e0b6f5a13d8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1242 microversion: 2.1 time: 0.125524 Aug 29 19:08:02.900465 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 13/22] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:02 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1242 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:02.932637 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3c14db12-597b-460f-b87d-4a06e0ef5a78 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:02.941546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3c14db12-597b-460f-b87d-4a06e0ef5a78 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1242 microversion: 2.1 time: 0.163793 Aug 29 19:08:02.950898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 10/23] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:02 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:03.045699 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:03.046657 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:03.053207 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:03.053902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:03.054499 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:03.055237 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:03.055854 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:03.056313 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:03.136158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:03.147179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:03.150751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:03.152048 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5be05f36-9b4d-4a29-9ea0-8b7dbc98e778 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1284 microversion: 2.20 time: 0.110290 Aug 29 19:08:03.153050 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 14/24] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:03 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:03.501046 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-acb904c1-fa3e-4346-9c85-34a0b1608711 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:03.501578 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-acb904c1-fa3e-4346-9c85-34a0b1608711 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:03.508026 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acb904c1-fa3e-4346-9c85-34a0b1608711 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:03.508521 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acb904c1-fa3e-4346-9c85-34a0b1608711 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:03.508991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acb904c1-fa3e-4346-9c85-34a0b1608711 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:03.509696 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acb904c1-fa3e-4346-9c85-34a0b1608711 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:03.510159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acb904c1-fa3e-4346-9c85-34a0b1608711 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:03.510591 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acb904c1-fa3e-4346-9c85-34a0b1608711 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:03.574289 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-acb904c1-fa3e-4346-9c85-34a0b1608711 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:03.582918 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-acb904c1-fa3e-4346-9c85-34a0b1608711 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1217 microversion: 2.1 time: 0.085762 Aug 29 19:08:03.583541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 11/25] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:03 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:03.650529 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c7b2fb84-aaa8-48e4-b09a-21dc5b44eee4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:03.651274 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c7b2fb84-aaa8-48e4-b09a-21dc5b44eee4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:03.658011 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c7b2fb84-aaa8-48e4-b09a-21dc5b44eee4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:03.658719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c7b2fb84-aaa8-48e4-b09a-21dc5b44eee4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:03.659329 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c7b2fb84-aaa8-48e4-b09a-21dc5b44eee4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:03.661397 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c7b2fb84-aaa8-48e4-b09a-21dc5b44eee4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:03.662123 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c7b2fb84-aaa8-48e4-b09a-21dc5b44eee4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:03.662737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c7b2fb84-aaa8-48e4-b09a-21dc5b44eee4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:03.733815 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c7b2fb84-aaa8-48e4-b09a-21dc5b44eee4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:03.743019 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c7b2fb84-aaa8-48e4-b09a-21dc5b44eee4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1210 microversion: 2.1 time: 0.096359 Aug 29 19:08:03.745092 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 15/26] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:03 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:03.923775 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-4d551ec5-737f-443c-8261-7e0964dd5a94 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:03.925267 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-4d551ec5-737f-443c-8261-7e0964dd5a94 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:03.939401 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d551ec5-737f-443c-8261-7e0964dd5a94 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:03.944040 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d551ec5-737f-443c-8261-7e0964dd5a94 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:03.944698 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d551ec5-737f-443c-8261-7e0964dd5a94 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:03.945726 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d551ec5-737f-443c-8261-7e0964dd5a94 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:03.946460 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d551ec5-737f-443c-8261-7e0964dd5a94 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:03.953828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d551ec5-737f-443c-8261-7e0964dd5a94 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:03.964629 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c12a8d78-11ff-4b97-a876-9c41c32173d3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:03.965469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c12a8d78-11ff-4b97-a876-9c41c32173d3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:03.975896 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c12a8d78-11ff-4b97-a876-9c41c32173d3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:03.976725 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c12a8d78-11ff-4b97-a876-9c41c32173d3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:03.977326 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c12a8d78-11ff-4b97-a876-9c41c32173d3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:03.983326 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c12a8d78-11ff-4b97-a876-9c41c32173d3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:03.984027 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c12a8d78-11ff-4b97-a876-9c41c32173d3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:03.984648 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c12a8d78-11ff-4b97-a876-9c41c32173d3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:04.078272 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4d551ec5-737f-443c-8261-7e0964dd5a94 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:04.095270 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-4d551ec5-737f-443c-8261-7e0964dd5a94 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1246 microversion: 2.1 time: 0.173461 Aug 29 19:08:04.108509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 12/27] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:03 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1246 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:04.151785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c12a8d78-11ff-4b97-a876-9c41c32173d3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:04.173880 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c12a8d78-11ff-4b97-a876-9c41c32173d3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1242 microversion: 2.1 time: 0.214357 Aug 29 19:08:04.174893 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 16/28] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:03 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1242 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:04.183045 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:04.183775 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:04.218394 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:04.225013 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:04.226255 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:04.231633 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:04.235727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:04.236481 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:04.451806 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:04.463961 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:04.482558 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:04.485277 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-895b659d-3ba9-41b8-8a59-836a14cdcb1d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1276 microversion: 2.20 time: 0.313606 Aug 29 19:08:04.502856 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 13/29] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:04 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1276 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:08:04.616069 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9a7c4ed9-f268-46f3-9071-889d41b3396d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:04.616727 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9a7c4ed9-f268-46f3-9071-889d41b3396d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:04.655477 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a7c4ed9-f268-46f3-9071-889d41b3396d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:04.656716 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a7c4ed9-f268-46f3-9071-889d41b3396d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:04.657372 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a7c4ed9-f268-46f3-9071-889d41b3396d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:04.659312 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a7c4ed9-f268-46f3-9071-889d41b3396d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:04.660227 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a7c4ed9-f268-46f3-9071-889d41b3396d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:04.661182 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a7c4ed9-f268-46f3-9071-889d41b3396d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:04.744354 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9a7c4ed9-f268-46f3-9071-889d41b3396d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:04.752577 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9a7c4ed9-f268-46f3-9071-889d41b3396d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1273 microversion: 2.1 time: 0.151775 Aug 29 19:08:04.766328 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 17/30] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:04 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1273 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:04.771712 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-01d76e17-a048-4256-978f-f3257e022f56 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:04.772440 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-01d76e17-a048-4256-978f-f3257e022f56 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:04.779954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01d76e17-a048-4256-978f-f3257e022f56 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:04.780473 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01d76e17-a048-4256-978f-f3257e022f56 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:04.781062 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01d76e17-a048-4256-978f-f3257e022f56 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:04.781903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01d76e17-a048-4256-978f-f3257e022f56 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:04.782489 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01d76e17-a048-4256-978f-f3257e022f56 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:04.783022 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01d76e17-a048-4256-978f-f3257e022f56 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:04.965172 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-01d76e17-a048-4256-978f-f3257e022f56 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:04.974856 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-01d76e17-a048-4256-978f-f3257e022f56 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.207615 Aug 29 19:08:04.975677 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 14/31] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:04 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:05.130470 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c0f07b8e-7c62-4740-9dcd-0aedd56e6629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:05.131244 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c0f07b8e-7c62-4740-9dcd-0aedd56e6629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:05.142462 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:05.158460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0f07b8e-7c62-4740-9dcd-0aedd56e6629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:05.159271 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0f07b8e-7c62-4740-9dcd-0aedd56e6629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:05.161841 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0f07b8e-7c62-4740-9dcd-0aedd56e6629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:05.162971 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0f07b8e-7c62-4740-9dcd-0aedd56e6629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:05.166463 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0f07b8e-7c62-4740-9dcd-0aedd56e6629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:05.169380 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0f07b8e-7c62-4740-9dcd-0aedd56e6629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:05.197849 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-19799e29-de60-4fe9-b1f0-1cdbe774e7cf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:05.198697 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-19799e29-de60-4fe9-b1f0-1cdbe774e7cf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:05.205603 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:05.211666 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-19799e29-de60-4fe9-b1f0-1cdbe774e7cf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:05.213998 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-19799e29-de60-4fe9-b1f0-1cdbe774e7cf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:05.218832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-19799e29-de60-4fe9-b1f0-1cdbe774e7cf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:05.221458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-19799e29-de60-4fe9-b1f0-1cdbe774e7cf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:05.222163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-19799e29-de60-4fe9-b1f0-1cdbe774e7cf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:05.223706 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-19799e29-de60-4fe9-b1f0-1cdbe774e7cf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:05.405516 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c0f07b8e-7c62-4740-9dcd-0aedd56e6629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:05.447690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c0f07b8e-7c62-4740-9dcd-0aedd56e6629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.319520 Aug 29 19:08:05.448463 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 18/32] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:05 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:05.490606 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-19799e29-de60-4fe9-b1f0-1cdbe774e7cf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:05.511927 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:05.512900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:05.541265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-19799e29-de60-4fe9-b1f0-1cdbe774e7cf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.347535 Aug 29 19:08:05.547970 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:05.548459 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:05.548894 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:05.549393 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 15/33] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:05 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:05.556469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:05.556965 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:05.557660 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:05.679194 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:05.689305 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:05.691490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:05.692980 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-183ad4c0-f0bb-4f76-ab41-8612419152a4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.188950 Aug 29 19:08:05.694007 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 19/34] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:05 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:08:05.774568 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-cfce2ed3-089a-46c7-83a9-bca5b931ee72 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:05.775408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-cfce2ed3-089a-46c7-83a9-bca5b931ee72 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:05.786742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cfce2ed3-089a-46c7-83a9-bca5b931ee72 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:05.787800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cfce2ed3-089a-46c7-83a9-bca5b931ee72 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:05.788427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cfce2ed3-089a-46c7-83a9-bca5b931ee72 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:05.789952 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cfce2ed3-089a-46c7-83a9-bca5b931ee72 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:05.796117 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cfce2ed3-089a-46c7-83a9-bca5b931ee72 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:05.796810 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cfce2ed3-089a-46c7-83a9-bca5b931ee72 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:05.935882 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-cfce2ed3-089a-46c7-83a9-bca5b931ee72 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:05.961486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-cfce2ed3-089a-46c7-83a9-bca5b931ee72 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1281 microversion: 2.1 time: 0.191097 Aug 29 19:08:05.978422 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 16/35] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:05 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1281 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:05.997952 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9466a4db-05fb-476a-9ba4-8f7336bc4824 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:05.998576 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9466a4db-05fb-476a-9ba4-8f7336bc4824 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:06.006759 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9466a4db-05fb-476a-9ba4-8f7336bc4824 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:06.007326 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9466a4db-05fb-476a-9ba4-8f7336bc4824 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:06.007953 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9466a4db-05fb-476a-9ba4-8f7336bc4824 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:06.008822 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9466a4db-05fb-476a-9ba4-8f7336bc4824 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:06.009285 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9466a4db-05fb-476a-9ba4-8f7336bc4824 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:06.009716 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9466a4db-05fb-476a-9ba4-8f7336bc4824 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:06.106100 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9466a4db-05fb-476a-9ba4-8f7336bc4824 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:06.115267 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9466a4db-05fb-476a-9ba4-8f7336bc4824 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.121348 Aug 29 19:08:06.119586 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 20/36] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:05 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:06.472249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-4e5c74ff-a88d-4ea9-ae51-308c07365bc9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:06.473063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-4e5c74ff-a88d-4ea9-ae51-308c07365bc9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:06.480560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4e5c74ff-a88d-4ea9-ae51-308c07365bc9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:06.481272 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4e5c74ff-a88d-4ea9-ae51-308c07365bc9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:06.481900 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4e5c74ff-a88d-4ea9-ae51-308c07365bc9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:06.482628 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4e5c74ff-a88d-4ea9-ae51-308c07365bc9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:06.483115 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4e5c74ff-a88d-4ea9-ae51-308c07365bc9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:06.483567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4e5c74ff-a88d-4ea9-ae51-308c07365bc9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:06.554113 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4e5c74ff-a88d-4ea9-ae51-308c07365bc9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:06.561887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-4e5c74ff-a88d-4ea9-ae51-308c07365bc9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.093476 Aug 29 19:08:06.562759 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 17/37] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:06 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:06.571196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-69e70653-8f28-4d43-b449-b0faa565bb15 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:06.571807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-69e70653-8f28-4d43-b449-b0faa565bb15 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:06.578512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69e70653-8f28-4d43-b449-b0faa565bb15 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:06.578979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69e70653-8f28-4d43-b449-b0faa565bb15 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:06.579486 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69e70653-8f28-4d43-b449-b0faa565bb15 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:06.580180 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69e70653-8f28-4d43-b449-b0faa565bb15 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:06.580628 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69e70653-8f28-4d43-b449-b0faa565bb15 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:06.581041 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69e70653-8f28-4d43-b449-b0faa565bb15 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:06.643414 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-69e70653-8f28-4d43-b449-b0faa565bb15 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:06.651144 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-69e70653-8f28-4d43-b449-b0faa565bb15 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.085242 Aug 29 19:08:06.651709 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 21/38] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:06 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:06.716307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:06.717257 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:06.724291 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:06.724872 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:06.725313 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:06.726019 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:06.726471 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:06.726943 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:06.789040 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:06.797273 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:06.798705 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:06.799863 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0c1bc992-790e-4ea7-a876-6b54698a99fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.087601 Aug 29 19:08:06.800429 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 18/39] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:06 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:06.994464 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ded0191d-cc6b-4a23-90c2-c8aeaf7b0708 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:06.995203 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ded0191d-cc6b-4a23-90c2-c8aeaf7b0708 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:07.001365 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ded0191d-cc6b-4a23-90c2-c8aeaf7b0708 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:07.001926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ded0191d-cc6b-4a23-90c2-c8aeaf7b0708 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:07.002429 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ded0191d-cc6b-4a23-90c2-c8aeaf7b0708 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:07.003220 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ded0191d-cc6b-4a23-90c2-c8aeaf7b0708 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:07.004287 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ded0191d-cc6b-4a23-90c2-c8aeaf7b0708 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:07.004806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ded0191d-cc6b-4a23-90c2-c8aeaf7b0708 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:07.074363 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ded0191d-cc6b-4a23-90c2-c8aeaf7b0708 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:07.083043 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ded0191d-cc6b-4a23-90c2-c8aeaf7b0708 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1281 microversion: 2.1 time: 0.091808 Aug 29 19:08:07.083594 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 22/40] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:06 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1281 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:07.140608 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-02555a05-32fd-497b-9d5a-9dad90d2b21f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:07.141249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-02555a05-32fd-497b-9d5a-9dad90d2b21f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:07.147187 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02555a05-32fd-497b-9d5a-9dad90d2b21f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:07.147663 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02555a05-32fd-497b-9d5a-9dad90d2b21f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:07.148098 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02555a05-32fd-497b-9d5a-9dad90d2b21f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:07.148809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02555a05-32fd-497b-9d5a-9dad90d2b21f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:07.149263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02555a05-32fd-497b-9d5a-9dad90d2b21f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:07.149679 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02555a05-32fd-497b-9d5a-9dad90d2b21f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:07.212468 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-02555a05-32fd-497b-9d5a-9dad90d2b21f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:07.220003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-02555a05-32fd-497b-9d5a-9dad90d2b21f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.083256 Aug 29 19:08:07.220576 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 19/41] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:07 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:07.584123 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-661f486b-9561-44b2-86a0-ae9ce538e03f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:07.584731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-661f486b-9561-44b2-86a0-ae9ce538e03f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:07.590968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-661f486b-9561-44b2-86a0-ae9ce538e03f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:07.591430 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-661f486b-9561-44b2-86a0-ae9ce538e03f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:07.591869 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-661f486b-9561-44b2-86a0-ae9ce538e03f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:07.592563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-661f486b-9561-44b2-86a0-ae9ce538e03f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:07.593039 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-661f486b-9561-44b2-86a0-ae9ce538e03f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:07.593456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-661f486b-9561-44b2-86a0-ae9ce538e03f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:07.654974 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-661f486b-9561-44b2-86a0-ae9ce538e03f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:07.662652 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-661f486b-9561-44b2-86a0-ae9ce538e03f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.083510 Aug 29 19:08:07.663254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 23/42] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:07 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:07.672027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c4558c5f-001f-427e-b834-31ee850a89fc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:07.672643 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c4558c5f-001f-427e-b834-31ee850a89fc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:07.678815 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4558c5f-001f-427e-b834-31ee850a89fc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:07.679347 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4558c5f-001f-427e-b834-31ee850a89fc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:07.679780 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4558c5f-001f-427e-b834-31ee850a89fc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:07.680471 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4558c5f-001f-427e-b834-31ee850a89fc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:07.680931 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4558c5f-001f-427e-b834-31ee850a89fc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:07.681355 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c4558c5f-001f-427e-b834-31ee850a89fc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:07.741773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c4558c5f-001f-427e-b834-31ee850a89fc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:07.749480 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c4558c5f-001f-427e-b834-31ee850a89fc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.081326 Aug 29 19:08:07.750049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 20/43] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:07 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:07.824712 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:07.825583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:07.837570 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:07.838280 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:07.839582 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:07.840457 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:07.841182 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:07.841754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:07.930903 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:07.942152 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:07.943917 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:07.945222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-aa5a215a-253f-410f-aab0-73ca46e33ca8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.125869 Aug 29 19:08:07.945957 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 24/44] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:07 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:08.104865 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b1efa949-717a-4577-836c-dcc9ebcdeaca tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:08.105399 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b1efa949-717a-4577-836c-dcc9ebcdeaca tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:08.111868 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1efa949-717a-4577-836c-dcc9ebcdeaca tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:08.112359 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1efa949-717a-4577-836c-dcc9ebcdeaca tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:08.113135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1efa949-717a-4577-836c-dcc9ebcdeaca tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:08.114048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1efa949-717a-4577-836c-dcc9ebcdeaca tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:08.114635 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1efa949-717a-4577-836c-dcc9ebcdeaca tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:08.115362 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1efa949-717a-4577-836c-dcc9ebcdeaca tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:08.197290 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b1efa949-717a-4577-836c-dcc9ebcdeaca tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:08.210474 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b1efa949-717a-4577-836c-dcc9ebcdeaca tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1281 microversion: 2.1 time: 0.109478 Aug 29 19:08:08.211154 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 21/45] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:08 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1281 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:08.241478 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ed039e40-2d55-4bf4-8afe-5d5e1b72a39d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:08.242213 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ed039e40-2d55-4bf4-8afe-5d5e1b72a39d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:08.248895 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ed039e40-2d55-4bf4-8afe-5d5e1b72a39d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:08.249471 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ed039e40-2d55-4bf4-8afe-5d5e1b72a39d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:08.250121 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ed039e40-2d55-4bf4-8afe-5d5e1b72a39d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:08.250831 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ed039e40-2d55-4bf4-8afe-5d5e1b72a39d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:08.251320 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ed039e40-2d55-4bf4-8afe-5d5e1b72a39d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:08.251748 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ed039e40-2d55-4bf4-8afe-5d5e1b72a39d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:08.273833 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:08.329593 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ed039e40-2d55-4bf4-8afe-5d5e1b72a39d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:08.338852 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ed039e40-2d55-4bf4-8afe-5d5e1b72a39d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.101758 Aug 29 19:08:08.339803 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 25/46] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:08 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:08.683178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1281a35f-a704-4f44-9668-9a73ec32b2e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:08.683790 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1281a35f-a704-4f44-9668-9a73ec32b2e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:08.689920 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1281a35f-a704-4f44-9668-9a73ec32b2e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:08.690408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1281a35f-a704-4f44-9668-9a73ec32b2e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:08.690843 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1281a35f-a704-4f44-9668-9a73ec32b2e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:08.691567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1281a35f-a704-4f44-9668-9a73ec32b2e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:08.692068 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1281a35f-a704-4f44-9668-9a73ec32b2e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:08.692494 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1281a35f-a704-4f44-9668-9a73ec32b2e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:08.757262 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1281a35f-a704-4f44-9668-9a73ec32b2e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:08.766733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1281a35f-a704-4f44-9668-9a73ec32b2e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.087343 Aug 29 19:08:08.767423 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 22/47] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:08 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:08.770380 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-4c6671b3-4e38-4fd2-bd32-c1b05cc0c55d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:08.770989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-4c6671b3-4e38-4fd2-bd32-c1b05cc0c55d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:08.778518 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c6671b3-4e38-4fd2-bd32-c1b05cc0c55d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:08.779737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c6671b3-4e38-4fd2-bd32-c1b05cc0c55d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:08.780437 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c6671b3-4e38-4fd2-bd32-c1b05cc0c55d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:08.781407 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c6671b3-4e38-4fd2-bd32-c1b05cc0c55d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:08.782042 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c6671b3-4e38-4fd2-bd32-c1b05cc0c55d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:08.782489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c6671b3-4e38-4fd2-bd32-c1b05cc0c55d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:08.854175 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-4c6671b3-4e38-4fd2-bd32-c1b05cc0c55d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:08.862111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-4c6671b3-4e38-4fd2-bd32-c1b05cc0c55d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.096022 Aug 29 19:08:08.862720 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 26/48] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:08 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:08.971734 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:08.973343 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:08.982124 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:08.983003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:08.983729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:08.984821 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:08.985431 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:08.986682 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:09.015975 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:09.077909 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:09.091345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:09.095179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:09.096674 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e7cbbdcc-9086-457b-9b90-5ddfdf7ef2be tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.131374 Aug 29 19:08:09.103893 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 23/49] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:08 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:09.237025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a8d1c93e-bb78-4f20-8825-1e20ebcd033b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:09.237645 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a8d1c93e-bb78-4f20-8825-1e20ebcd033b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:09.245871 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8d1c93e-bb78-4f20-8825-1e20ebcd033b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:09.246553 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8d1c93e-bb78-4f20-8825-1e20ebcd033b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:09.246910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8d1c93e-bb78-4f20-8825-1e20ebcd033b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:09.247635 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8d1c93e-bb78-4f20-8825-1e20ebcd033b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:09.248355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8d1c93e-bb78-4f20-8825-1e20ebcd033b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:09.248677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8d1c93e-bb78-4f20-8825-1e20ebcd033b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:09.346248 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a8d1c93e-bb78-4f20-8825-1e20ebcd033b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:09.358605 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a8d1c93e-bb78-4f20-8825-1e20ebcd033b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1281 microversion: 2.1 time: 0.124962 Aug 29 19:08:09.367143 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-12d9019e-5c78-4878-b6a6-d5e9da8cafbc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:09.367143 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-12d9019e-5c78-4878-b6a6-d5e9da8cafbc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:09.368158 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-12d9019e-5c78-4878-b6a6-d5e9da8cafbc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:09.368557 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 27/50] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:09 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1281 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:09.368684 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-12d9019e-5c78-4878-b6a6-d5e9da8cafbc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:09.369069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-12d9019e-5c78-4878-b6a6-d5e9da8cafbc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:09.371944 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-12d9019e-5c78-4878-b6a6-d5e9da8cafbc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:09.372162 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-12d9019e-5c78-4878-b6a6-d5e9da8cafbc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:09.372594 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-12d9019e-5c78-4878-b6a6-d5e9da8cafbc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:09.469622 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-12d9019e-5c78-4878-b6a6-d5e9da8cafbc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:09.480537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-12d9019e-5c78-4878-b6a6-d5e9da8cafbc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.124042 Aug 29 19:08:09.481640 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 24/51] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:09 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:09.787950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fd4db12f-1e33-43fd-95b6-37bef7d7d9a7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:09.788563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fd4db12f-1e33-43fd-95b6-37bef7d7d9a7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:09.795221 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd4db12f-1e33-43fd-95b6-37bef7d7d9a7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:09.795940 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd4db12f-1e33-43fd-95b6-37bef7d7d9a7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:09.796868 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd4db12f-1e33-43fd-95b6-37bef7d7d9a7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:09.798037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd4db12f-1e33-43fd-95b6-37bef7d7d9a7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:09.798750 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd4db12f-1e33-43fd-95b6-37bef7d7d9a7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:09.799481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd4db12f-1e33-43fd-95b6-37bef7d7d9a7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:09.874203 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fd4db12f-1e33-43fd-95b6-37bef7d7d9a7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:09.884495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-094eff9c-060e-41a3-947a-581df5828298 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:09.885108 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-094eff9c-060e-41a3-947a-581df5828298 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:09.885954 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fd4db12f-1e33-43fd-95b6-37bef7d7d9a7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.102111 Aug 29 19:08:09.886746 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 28/52] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:09 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:09.891980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-094eff9c-060e-41a3-947a-581df5828298 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:09.892741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-094eff9c-060e-41a3-947a-581df5828298 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:09.893332 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-094eff9c-060e-41a3-947a-581df5828298 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:09.894327 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-094eff9c-060e-41a3-947a-581df5828298 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:09.897817 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-094eff9c-060e-41a3-947a-581df5828298 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:09.898436 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-094eff9c-060e-41a3-947a-581df5828298 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:09.970598 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-094eff9c-060e-41a3-947a-581df5828298 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:09.979416 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-094eff9c-060e-41a3-947a-581df5828298 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.099056 Aug 29 19:08:09.979999 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 25/53] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:09 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:10.121814 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:10.122942 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:10.129938 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:10.130511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:10.130845 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:10.131671 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:10.132434 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:10.133002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:10.231064 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:10.240958 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:10.242758 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:10.244119 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1380f3e8-abdb-406e-beb6-ae58b7b6311b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.126942 Aug 29 19:08:10.245455 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 29/54] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:10 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:10.381727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-693f3e58-7505-459f-ba11-660815cc86e3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:10.382353 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-693f3e58-7505-459f-ba11-660815cc86e3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:10.389224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-693f3e58-7505-459f-ba11-660815cc86e3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:10.389759 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-693f3e58-7505-459f-ba11-660815cc86e3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:10.390219 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-693f3e58-7505-459f-ba11-660815cc86e3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:10.390942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-693f3e58-7505-459f-ba11-660815cc86e3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:10.391451 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-693f3e58-7505-459f-ba11-660815cc86e3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:10.391891 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-693f3e58-7505-459f-ba11-660815cc86e3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:10.475147 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-693f3e58-7505-459f-ba11-660815cc86e3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:10.487472 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-693f3e58-7505-459f-ba11-660815cc86e3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1281 microversion: 2.1 time: 0.109907 Aug 29 19:08:10.488698 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 26/55] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:10 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1281 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:10.509520 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-65cc6b01-037f-4047-8bfc-2f6abd6d5913 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:10.509520 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-65cc6b01-037f-4047-8bfc-2f6abd6d5913 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:10.515492 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-65cc6b01-037f-4047-8bfc-2f6abd6d5913 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:10.516362 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-65cc6b01-037f-4047-8bfc-2f6abd6d5913 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:10.517029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-65cc6b01-037f-4047-8bfc-2f6abd6d5913 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:10.518155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-65cc6b01-037f-4047-8bfc-2f6abd6d5913 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:10.518811 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-65cc6b01-037f-4047-8bfc-2f6abd6d5913 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:10.519629 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-65cc6b01-037f-4047-8bfc-2f6abd6d5913 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:10.637630 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-65cc6b01-037f-4047-8bfc-2f6abd6d5913 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:10.650175 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-65cc6b01-037f-4047-8bfc-2f6abd6d5913 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.147612 Aug 29 19:08:10.667886 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 30/56] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:10 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:10.913072 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5c2b71ef-975f-4dcc-adff-cf648cde8597 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:10.913847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5c2b71ef-975f-4dcc-adff-cf648cde8597 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:10.922461 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c2b71ef-975f-4dcc-adff-cf648cde8597 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:10.922959 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c2b71ef-975f-4dcc-adff-cf648cde8597 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:10.923930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c2b71ef-975f-4dcc-adff-cf648cde8597 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:10.924876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c2b71ef-975f-4dcc-adff-cf648cde8597 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:10.925372 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c2b71ef-975f-4dcc-adff-cf648cde8597 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:10.930915 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c2b71ef-975f-4dcc-adff-cf648cde8597 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:11.005487 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5c2b71ef-975f-4dcc-adff-cf648cde8597 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:11.007799 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1e72c7d8-0f0c-4c4c-925e-8e91dc4e1bcf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:11.009512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1e72c7d8-0f0c-4c4c-925e-8e91dc4e1bcf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:11.020703 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e72c7d8-0f0c-4c4c-925e-8e91dc4e1bcf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:11.021510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e72c7d8-0f0c-4c4c-925e-8e91dc4e1bcf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:11.022313 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e72c7d8-0f0c-4c4c-925e-8e91dc4e1bcf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:11.023313 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e72c7d8-0f0c-4c4c-925e-8e91dc4e1bcf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:11.023429 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5c2b71ef-975f-4dcc-adff-cf648cde8597 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.116591 Aug 29 19:08:11.024039 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 27/57] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:10 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:11.038751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e72c7d8-0f0c-4c4c-925e-8e91dc4e1bcf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:11.039868 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e72c7d8-0f0c-4c4c-925e-8e91dc4e1bcf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:11.106894 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=6 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:11.137738 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1e72c7d8-0f0c-4c4c-925e-8e91dc4e1bcf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:11.147614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1e72c7d8-0f0c-4c4c-925e-8e91dc4e1bcf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.150989 Aug 29 19:08:11.148198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 31/58] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:10 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:11.270418 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:11.270935 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:11.277333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:11.278026 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:11.278636 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:11.279783 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:11.280265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:11.280702 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:11.371275 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:11.380907 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:11.383369 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:11.384597 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d0242a21-8eeb-47f9-87a4-e63d827b4079 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.118733 Aug 29 19:08:11.385686 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 28/59] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:11 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:11.513998 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b19fee52-b38e-43ac-9190-7213cc7e5198 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:11.515476 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b19fee52-b38e-43ac-9190-7213cc7e5198 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:11.527058 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19fee52-b38e-43ac-9190-7213cc7e5198 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:11.534076 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19fee52-b38e-43ac-9190-7213cc7e5198 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:11.534535 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19fee52-b38e-43ac-9190-7213cc7e5198 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:11.536124 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19fee52-b38e-43ac-9190-7213cc7e5198 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:11.536602 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19fee52-b38e-43ac-9190-7213cc7e5198 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:11.538139 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19fee52-b38e-43ac-9190-7213cc7e5198 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:11.666959 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b19fee52-b38e-43ac-9190-7213cc7e5198 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:11.678550 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-320d5afb-4974-4951-9779-72780506d301 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:11.679308 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-320d5afb-4974-4951-9779-72780506d301 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:11.688136 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-320d5afb-4974-4951-9779-72780506d301 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:11.688315 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b19fee52-b38e-43ac-9190-7213cc7e5198 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1281 microversion: 2.1 time: 0.177870 Aug 29 19:08:11.689372 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-320d5afb-4974-4951-9779-72780506d301 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:11.689510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 32/60] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:11 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1281 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:11.689811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-320d5afb-4974-4951-9779-72780506d301 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:11.690515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-320d5afb-4974-4951-9779-72780506d301 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:11.690972 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-320d5afb-4974-4951-9779-72780506d301 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:11.691653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-320d5afb-4974-4951-9779-72780506d301 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:11.784220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-320d5afb-4974-4951-9779-72780506d301 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:11.793596 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-320d5afb-4974-4951-9779-72780506d301 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.121651 Aug 29 19:08:11.794337 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 29/61] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:11 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:12.046367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7adbb5b6-d331-4004-9d4a-75ef8bda606c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:12.047041 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7adbb5b6-d331-4004-9d4a-75ef8bda606c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:12.053110 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7adbb5b6-d331-4004-9d4a-75ef8bda606c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:12.053821 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7adbb5b6-d331-4004-9d4a-75ef8bda606c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:12.054258 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7adbb5b6-d331-4004-9d4a-75ef8bda606c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:12.054949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7adbb5b6-d331-4004-9d4a-75ef8bda606c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:12.055626 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7adbb5b6-d331-4004-9d4a-75ef8bda606c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:12.056052 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7adbb5b6-d331-4004-9d4a-75ef8bda606c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:12.122764 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7adbb5b6-d331-4004-9d4a-75ef8bda606c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:12.134748 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7adbb5b6-d331-4004-9d4a-75ef8bda606c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.092372 Aug 29 19:08:12.135671 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 33/62] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:12 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:12.169378 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e6f0483b-3d6d-4cac-be1d-61f06627dda3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:12.170149 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e6f0483b-3d6d-4cac-be1d-61f06627dda3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:12.176992 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6f0483b-3d6d-4cac-be1d-61f06627dda3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:12.177865 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6f0483b-3d6d-4cac-be1d-61f06627dda3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:12.178521 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6f0483b-3d6d-4cac-be1d-61f06627dda3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:12.179490 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6f0483b-3d6d-4cac-be1d-61f06627dda3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:12.180154 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6f0483b-3d6d-4cac-be1d-61f06627dda3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:12.180895 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6f0483b-3d6d-4cac-be1d-61f06627dda3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:12.253261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e6f0483b-3d6d-4cac-be1d-61f06627dda3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:12.264213 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e6f0483b-3d6d-4cac-be1d-61f06627dda3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.098630 Aug 29 19:08:12.266114 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 30/63] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:12 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:12.409720 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:12.410746 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:12.424699 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:12.424972 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:12.425412 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:12.428361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:12.428966 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:12.429619 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:12.517801 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:12.534536 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:12.538249 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:12.540490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a8c553a2-f719-4c0f-9a6e-ac343d2e3e98 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.134588 Aug 29 19:08:12.555221 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 34/64] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:12 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:12.714051 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-970e9615-6dd1-4125-acd1-8cfd39e99304 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:12.716028 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-970e9615-6dd1-4125-acd1-8cfd39e99304 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:12.719495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=6 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:12.720916 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=30 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:12.727028 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-970e9615-6dd1-4125-acd1-8cfd39e99304 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:12.741131 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-970e9615-6dd1-4125-acd1-8cfd39e99304 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:12.742142 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-970e9615-6dd1-4125-acd1-8cfd39e99304 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:12.743841 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-970e9615-6dd1-4125-acd1-8cfd39e99304 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:12.744498 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-970e9615-6dd1-4125-acd1-8cfd39e99304 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:12.747768 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-970e9615-6dd1-4125-acd1-8cfd39e99304 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:12.820981 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6c58858a-654a-4e54-86e1-6f355bc19c8d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:12.822257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6c58858a-654a-4e54-86e1-6f355bc19c8d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:12.845146 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c58858a-654a-4e54-86e1-6f355bc19c8d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:12.846271 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c58858a-654a-4e54-86e1-6f355bc19c8d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:12.848082 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c58858a-654a-4e54-86e1-6f355bc19c8d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:12.851229 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c58858a-654a-4e54-86e1-6f355bc19c8d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:12.852027 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c58858a-654a-4e54-86e1-6f355bc19c8d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:12.853055 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c58858a-654a-4e54-86e1-6f355bc19c8d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:12.902876 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=32 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:12.912727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-970e9615-6dd1-4125-acd1-8cfd39e99304 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:12.932791 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-970e9615-6dd1-4125-acd1-8cfd39e99304 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1281 microversion: 2.1 time: 0.225664 Aug 29 19:08:12.956160 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 31/65] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:12 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1281 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:13.021817 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6c58858a-654a-4e54-86e1-6f355bc19c8d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:13.041044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6c58858a-654a-4e54-86e1-6f355bc19c8d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.228672 Aug 29 19:08:13.054638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 35/66] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:12 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:13.158844 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-cab500fc-3084-40b2-aa0e-418f111fdd64 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:13.162589 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-cab500fc-3084-40b2-aa0e-418f111fdd64 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:13.168939 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cab500fc-3084-40b2-aa0e-418f111fdd64 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:13.169422 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cab500fc-3084-40b2-aa0e-418f111fdd64 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:13.169848 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cab500fc-3084-40b2-aa0e-418f111fdd64 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:13.170709 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cab500fc-3084-40b2-aa0e-418f111fdd64 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:13.171341 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cab500fc-3084-40b2-aa0e-418f111fdd64 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:13.171901 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cab500fc-3084-40b2-aa0e-418f111fdd64 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:13.246419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-cab500fc-3084-40b2-aa0e-418f111fdd64 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:13.255371 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-cab500fc-3084-40b2-aa0e-418f111fdd64 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.101967 Aug 29 19:08:13.256870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 32/67] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:13 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:13.294678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d8d5af26-569a-4ffe-804b-bc62f9e0afa3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:13.295908 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d8d5af26-569a-4ffe-804b-bc62f9e0afa3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:13.304661 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d8d5af26-569a-4ffe-804b-bc62f9e0afa3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:13.306926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d8d5af26-569a-4ffe-804b-bc62f9e0afa3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:13.307464 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d8d5af26-569a-4ffe-804b-bc62f9e0afa3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:13.312941 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d8d5af26-569a-4ffe-804b-bc62f9e0afa3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:13.313671 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d8d5af26-569a-4ffe-804b-bc62f9e0afa3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:13.315275 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d8d5af26-569a-4ffe-804b-bc62f9e0afa3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:13.399294 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d8d5af26-569a-4ffe-804b-bc62f9e0afa3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:13.407534 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d8d5af26-569a-4ffe-804b-bc62f9e0afa3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.123772 Aug 29 19:08:13.408433 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 36/68] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:13 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:13.596476 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:13.597396 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:13.607127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:13.614769 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:13.615500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:13.616279 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:13.616745 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:13.617585 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:13.703655 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:13.713331 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:13.714858 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:13.716008 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c2bf151c-e81a-4f9c-bff3-19dcaed1771c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.124792 Aug 29 19:08:13.716567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 33/69] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:13 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:13.966564 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-dac75ff7-447c-452c-a229-a9e9fc9a88b0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:13.969940 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-dac75ff7-447c-452c-a229-a9e9fc9a88b0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:13.981282 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dac75ff7-447c-452c-a229-a9e9fc9a88b0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:13.985386 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dac75ff7-447c-452c-a229-a9e9fc9a88b0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:13.986060 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dac75ff7-447c-452c-a229-a9e9fc9a88b0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:13.987283 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dac75ff7-447c-452c-a229-a9e9fc9a88b0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:13.987961 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dac75ff7-447c-452c-a229-a9e9fc9a88b0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:13.988523 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dac75ff7-447c-452c-a229-a9e9fc9a88b0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:14.071200 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e51d0fb9-5f61-4d72-aac4-af008c3e823c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:14.071200 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e51d0fb9-5f61-4d72-aac4-af008c3e823c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:14.071200 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e51d0fb9-5f61-4d72-aac4-af008c3e823c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:14.071200 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e51d0fb9-5f61-4d72-aac4-af008c3e823c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:14.071551 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-dac75ff7-447c-452c-a229-a9e9fc9a88b0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:14.071660 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e51d0fb9-5f61-4d72-aac4-af008c3e823c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:14.072227 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e51d0fb9-5f61-4d72-aac4-af008c3e823c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:14.072689 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e51d0fb9-5f61-4d72-aac4-af008c3e823c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:14.073116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e51d0fb9-5f61-4d72-aac4-af008c3e823c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:14.078726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-dac75ff7-447c-452c-a229-a9e9fc9a88b0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1281 microversion: 2.1 time: 0.116056 Aug 29 19:08:14.079966 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 37/70] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:13 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1281 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:14.280047 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2663062c-347a-45b2-b4bb-562f1a372db6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:14.280685 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2663062c-347a-45b2-b4bb-562f1a372db6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:14.296589 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2663062c-347a-45b2-b4bb-562f1a372db6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:14.299261 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2663062c-347a-45b2-b4bb-562f1a372db6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:14.299835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2663062c-347a-45b2-b4bb-562f1a372db6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:14.301580 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2663062c-347a-45b2-b4bb-562f1a372db6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:14.302110 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2663062c-347a-45b2-b4bb-562f1a372db6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:14.305721 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2663062c-347a-45b2-b4bb-562f1a372db6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:14.320121 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e51d0fb9-5f61-4d72-aac4-af008c3e823c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:14.340102 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e51d0fb9-5f61-4d72-aac4-af008c3e823c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.282125 Aug 29 19:08:14.340828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 34/71] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:14 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:14.430057 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7a56cd60-9c3c-43a9-91aa-c581eea7f363 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:14.431002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7a56cd60-9c3c-43a9-91aa-c581eea7f363 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:14.440774 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a56cd60-9c3c-43a9-91aa-c581eea7f363 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:14.442076 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a56cd60-9c3c-43a9-91aa-c581eea7f363 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:14.442727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a56cd60-9c3c-43a9-91aa-c581eea7f363 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:14.443741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a56cd60-9c3c-43a9-91aa-c581eea7f363 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:14.444407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a56cd60-9c3c-43a9-91aa-c581eea7f363 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:14.445018 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2663062c-347a-45b2-b4bb-562f1a372db6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:14.445307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a56cd60-9c3c-43a9-91aa-c581eea7f363 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:14.464385 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2663062c-347a-45b2-b4bb-562f1a372db6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.189440 Aug 29 19:08:14.465730 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 38/72] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:14 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:14.554294 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7a56cd60-9c3c-43a9-91aa-c581eea7f363 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:14.563979 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7a56cd60-9c3c-43a9-91aa-c581eea7f363 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.138372 Aug 29 19:08:14.565143 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 35/73] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:14 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:14.742847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:14.742847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:14.747882 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:14.748579 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:14.749289 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:14.756491 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:14.757005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:14.757453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:14.853901 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:14.871955 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:14.873521 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:14.874703 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-297502f7-b2d7-47e6-880a-f44ac1313170 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.138982 Aug 29 19:08:14.890677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 39/74] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:14 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:15.103011 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-87ae62b8-4020-45b0-8f84-53ef56298000 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:15.103941 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-87ae62b8-4020-45b0-8f84-53ef56298000 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:15.112601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-87ae62b8-4020-45b0-8f84-53ef56298000 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:15.113168 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-87ae62b8-4020-45b0-8f84-53ef56298000 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:15.114193 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-87ae62b8-4020-45b0-8f84-53ef56298000 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:15.116249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-87ae62b8-4020-45b0-8f84-53ef56298000 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:15.116775 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-87ae62b8-4020-45b0-8f84-53ef56298000 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:15.118222 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-87ae62b8-4020-45b0-8f84-53ef56298000 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:15.200073 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-87ae62b8-4020-45b0-8f84-53ef56298000 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:15.214172 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-87ae62b8-4020-45b0-8f84-53ef56298000 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1281 microversion: 2.1 time: 0.115530 Aug 29 19:08:15.218230 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 36/75] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:15 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:15.365827 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ddd1bfb7-0488-4228-85d8-346b1597850f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:15.367180 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ddd1bfb7-0488-4228-85d8-346b1597850f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:15.381711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ddd1bfb7-0488-4228-85d8-346b1597850f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:15.382400 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ddd1bfb7-0488-4228-85d8-346b1597850f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:15.382943 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ddd1bfb7-0488-4228-85d8-346b1597850f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:15.383898 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ddd1bfb7-0488-4228-85d8-346b1597850f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:15.384395 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ddd1bfb7-0488-4228-85d8-346b1597850f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:15.384999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ddd1bfb7-0488-4228-85d8-346b1597850f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:15.456655 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ddd1bfb7-0488-4228-85d8-346b1597850f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:15.468332 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ddd1bfb7-0488-4228-85d8-346b1597850f tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.106973 Aug 29 19:08:15.469195 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 40/76] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:15 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:15.485654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-21d2b015-79e3-4e87-b843-56635b501fbe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:15.486287 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-21d2b015-79e3-4e87-b843-56635b501fbe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:15.492541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21d2b015-79e3-4e87-b843-56635b501fbe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:15.493019 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21d2b015-79e3-4e87-b843-56635b501fbe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:15.493446 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21d2b015-79e3-4e87-b843-56635b501fbe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:15.494206 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21d2b015-79e3-4e87-b843-56635b501fbe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:15.494569 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21d2b015-79e3-4e87-b843-56635b501fbe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:15.494988 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21d2b015-79e3-4e87-b843-56635b501fbe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:15.563416 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-21d2b015-79e3-4e87-b843-56635b501fbe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:15.572791 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-21d2b015-79e3-4e87-b843-56635b501fbe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.090896 Aug 29 19:08:15.573364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 37/77] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:15 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:15.592117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d4282d76-07eb-45a0-b917-48520a3bfbe5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:15.592729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d4282d76-07eb-45a0-b917-48520a3bfbe5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:15.600542 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4282d76-07eb-45a0-b917-48520a3bfbe5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:15.601149 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4282d76-07eb-45a0-b917-48520a3bfbe5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:15.601610 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4282d76-07eb-45a0-b917-48520a3bfbe5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:15.602303 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4282d76-07eb-45a0-b917-48520a3bfbe5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:15.602787 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4282d76-07eb-45a0-b917-48520a3bfbe5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:15.603285 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4282d76-07eb-45a0-b917-48520a3bfbe5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:15.668452 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d4282d76-07eb-45a0-b917-48520a3bfbe5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:15.677309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d4282d76-07eb-45a0-b917-48520a3bfbe5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.088925 Aug 29 19:08:15.678171 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 41/78] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:15 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:15.898198 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:15.898831 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:15.905071 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:15.905543 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:15.905967 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:15.906635 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:15.907092 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:15.907522 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:15.971314 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:15.980284 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:15.981718 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:15.982786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f2be59a0-a152-422e-ab98-f4aa7622ca54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.089145 Aug 29 19:08:15.983377 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 38/79] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:15 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:16.236646 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-541e1515-ebc8-4729-a08f-46673d166074 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:16.237259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-541e1515-ebc8-4729-a08f-46673d166074 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:16.243346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541e1515-ebc8-4729-a08f-46673d166074 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:16.243834 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541e1515-ebc8-4729-a08f-46673d166074 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:16.244268 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541e1515-ebc8-4729-a08f-46673d166074 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:16.244967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541e1515-ebc8-4729-a08f-46673d166074 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:16.245424 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541e1515-ebc8-4729-a08f-46673d166074 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:16.245849 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541e1515-ebc8-4729-a08f-46673d166074 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:16.249846 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:16.307185 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-541e1515-ebc8-4729-a08f-46673d166074 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:16.314730 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-541e1515-ebc8-4729-a08f-46673d166074 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1281 microversion: 2.1 time: 0.082038 Aug 29 19:08:16.315440 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 42/80] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:16 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1281 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:16.489518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f3f4de37-23da-4073-8e70-94d447bd68e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:16.490583 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f3f4de37-23da-4073-8e70-94d447bd68e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:16.496100 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3f4de37-23da-4073-8e70-94d447bd68e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:16.496597 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3f4de37-23da-4073-8e70-94d447bd68e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:16.497010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3f4de37-23da-4073-8e70-94d447bd68e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:16.497685 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3f4de37-23da-4073-8e70-94d447bd68e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:16.498129 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3f4de37-23da-4073-8e70-94d447bd68e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:16.498549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3f4de37-23da-4073-8e70-94d447bd68e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:16.559864 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f3f4de37-23da-4073-8e70-94d447bd68e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:16.567699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f3f4de37-23da-4073-8e70-94d447bd68e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.081586 Aug 29 19:08:16.568578 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 39/81] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:16 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:16.593747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0e0d4bdd-01ed-4e55-9327-f0d205426bba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:16.594347 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0e0d4bdd-01ed-4e55-9327-f0d205426bba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:16.600890 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0e0d4bdd-01ed-4e55-9327-f0d205426bba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:16.601376 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0e0d4bdd-01ed-4e55-9327-f0d205426bba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:16.601808 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0e0d4bdd-01ed-4e55-9327-f0d205426bba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:16.602495 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0e0d4bdd-01ed-4e55-9327-f0d205426bba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:16.602969 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0e0d4bdd-01ed-4e55-9327-f0d205426bba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:16.603433 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0e0d4bdd-01ed-4e55-9327-f0d205426bba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:16.663743 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0e0d4bdd-01ed-4e55-9327-f0d205426bba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:16.671487 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0e0d4bdd-01ed-4e55-9327-f0d205426bba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.081512 Aug 29 19:08:16.672111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 43/82] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:16 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:16.698174 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a5b8ea55-a33d-405a-9087-3ac8f0df3d28 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:16.698779 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a5b8ea55-a33d-405a-9087-3ac8f0df3d28 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:16.704732 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a5b8ea55-a33d-405a-9087-3ac8f0df3d28 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:16.705214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a5b8ea55-a33d-405a-9087-3ac8f0df3d28 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:16.705646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a5b8ea55-a33d-405a-9087-3ac8f0df3d28 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:16.706327 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a5b8ea55-a33d-405a-9087-3ac8f0df3d28 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:16.706780 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a5b8ea55-a33d-405a-9087-3ac8f0df3d28 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:16.707238 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a5b8ea55-a33d-405a-9087-3ac8f0df3d28 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:16.712001 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:16.771388 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a5b8ea55-a33d-405a-9087-3ac8f0df3d28 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:16.779404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a5b8ea55-a33d-405a-9087-3ac8f0df3d28 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.084790 Aug 29 19:08:16.779963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 40/83] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:16 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:17.006729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:17.007355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:17.013369 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.013847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.014277 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.014968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.015443 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.015867 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.077977 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:17.087136 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:17.088597 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:17.089696 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fa36dbb3-255d-4948-aadb-5d63832ae497 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.087884 Aug 29 19:08:17.090264 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 44/84] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:17 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:17.337191 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b5c758db-4cef-4b9e-a3ce-f3d5804ff256 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:17.337717 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b5c758db-4cef-4b9e-a3ce-f3d5804ff256 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:17.343790 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c758db-4cef-4b9e-a3ce-f3d5804ff256 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.344283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c758db-4cef-4b9e-a3ce-f3d5804ff256 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.344714 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c758db-4cef-4b9e-a3ce-f3d5804ff256 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.345450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c758db-4cef-4b9e-a3ce-f3d5804ff256 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.345892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c758db-4cef-4b9e-a3ce-f3d5804ff256 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.346310 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c758db-4cef-4b9e-a3ce-f3d5804ff256 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.409572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b5c758db-4cef-4b9e-a3ce-f3d5804ff256 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:17.417516 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b5c758db-4cef-4b9e-a3ce-f3d5804ff256 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1281 microversion: 2.1 time: 0.085744 Aug 29 19:08:17.418081 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 41/85] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:17 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:17.589631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fd805d41-ad0d-49d3-83a5-84e8225a4c21 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:17.590423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fd805d41-ad0d-49d3-83a5-84e8225a4c21 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:17.599306 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd805d41-ad0d-49d3-83a5-84e8225a4c21 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.600154 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd805d41-ad0d-49d3-83a5-84e8225a4c21 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.600443 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd805d41-ad0d-49d3-83a5-84e8225a4c21 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.601219 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd805d41-ad0d-49d3-83a5-84e8225a4c21 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.601847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd805d41-ad0d-49d3-83a5-84e8225a4c21 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.602266 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd805d41-ad0d-49d3-83a5-84e8225a4c21 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.677862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fd805d41-ad0d-49d3-83a5-84e8225a4c21 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:17.693260 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7ba2477a-66f0-4857-8006-a3d1707dbdc5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:17.694047 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7ba2477a-66f0-4857-8006-a3d1707dbdc5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:17.701980 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fd805d41-ad0d-49d3-83a5-84e8225a4c21 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1266 microversion: 2.1 time: 0.116472 Aug 29 19:08:17.703497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 45/86] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:17 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:17.710021 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7ba2477a-66f0-4857-8006-a3d1707dbdc5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.710535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7ba2477a-66f0-4857-8006-a3d1707dbdc5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.712178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7ba2477a-66f0-4857-8006-a3d1707dbdc5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.714549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7ba2477a-66f0-4857-8006-a3d1707dbdc5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.717180 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7ba2477a-66f0-4857-8006-a3d1707dbdc5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.730505 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7ba2477a-66f0-4857-8006-a3d1707dbdc5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.801946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0a112df4-11f0-4efa-80e9-b5bbd33339ff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:17.804071 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0a112df4-11f0-4efa-80e9-b5bbd33339ff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:17.822507 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a112df4-11f0-4efa-80e9-b5bbd33339ff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.828101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a112df4-11f0-4efa-80e9-b5bbd33339ff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.830402 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a112df4-11f0-4efa-80e9-b5bbd33339ff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.832581 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a112df4-11f0-4efa-80e9-b5bbd33339ff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:17.835541 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a112df4-11f0-4efa-80e9-b5bbd33339ff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:17.836788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a112df4-11f0-4efa-80e9-b5bbd33339ff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:17.953227 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7ba2477a-66f0-4857-8006-a3d1707dbdc5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:17.966763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7ba2477a-66f0-4857-8006-a3d1707dbdc5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.277814 Aug 29 19:08:17.968765 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 42/87] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:17 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:17.999091 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0a112df4-11f0-4efa-80e9-b5bbd33339ff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:18.007881 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0a112df4-11f0-4efa-80e9-b5bbd33339ff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.212090 Aug 29 19:08:18.008643 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 46/88] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:17 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:18.112798 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:18.113424 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:18.119677 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:18.120262 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:18.120764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:18.121468 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:18.121926 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:18.122351 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:18.245047 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:18.253596 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:18.255635 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:18.256778 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fcdca7ac-1e76-4400-baea-7bfc52a88f32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.147934 Aug 29 19:08:18.257339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 43/89] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:18 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:18.442983 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-60e9df9b-d4f0-4706-b1f8-ab40c4c2cea5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:18.444505 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-60e9df9b-d4f0-4706-b1f8-ab40c4c2cea5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:18.454726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-60e9df9b-d4f0-4706-b1f8-ab40c4c2cea5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:18.455613 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-60e9df9b-d4f0-4706-b1f8-ab40c4c2cea5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:18.456368 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-60e9df9b-d4f0-4706-b1f8-ab40c4c2cea5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:18.457587 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-60e9df9b-d4f0-4706-b1f8-ab40c4c2cea5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:18.458944 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-60e9df9b-d4f0-4706-b1f8-ab40c4c2cea5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:18.459742 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-60e9df9b-d4f0-4706-b1f8-ab40c4c2cea5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:18.583338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-60e9df9b-d4f0-4706-b1f8-ab40c4c2cea5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:18.592403 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-60e9df9b-d4f0-4706-b1f8-ab40c4c2cea5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1279 microversion: 2.1 time: 0.157284 Aug 29 19:08:18.593048 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 47/90] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:18 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:18.722786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f2aa434d-2b0a-4db4-8bf6-d7ab7e43ad3c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:18.724084 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f2aa434d-2b0a-4db4-8bf6-d7ab7e43ad3c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:18.730106 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2aa434d-2b0a-4db4-8bf6-d7ab7e43ad3c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:18.730592 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2aa434d-2b0a-4db4-8bf6-d7ab7e43ad3c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:18.731017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2aa434d-2b0a-4db4-8bf6-d7ab7e43ad3c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:18.731758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2aa434d-2b0a-4db4-8bf6-d7ab7e43ad3c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:18.732207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2aa434d-2b0a-4db4-8bf6-d7ab7e43ad3c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:18.732808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2aa434d-2b0a-4db4-8bf6-d7ab7e43ad3c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:18.888944 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f2aa434d-2b0a-4db4-8bf6-d7ab7e43ad3c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:18.898191 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f2aa434d-2b0a-4db4-8bf6-d7ab7e43ad3c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1284 microversion: 2.1 time: 0.179010 Aug 29 19:08:18.899242 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 44/91] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:18 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:18.988169 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a0e61667-bff5-465c-8a57-e53aca53ef5e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:18.988778 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a0e61667-bff5-465c-8a57-e53aca53ef5e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:18.995530 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a0e61667-bff5-465c-8a57-e53aca53ef5e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:18.996016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a0e61667-bff5-465c-8a57-e53aca53ef5e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:18.996455 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a0e61667-bff5-465c-8a57-e53aca53ef5e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:18.997572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a0e61667-bff5-465c-8a57-e53aca53ef5e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:18.997572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a0e61667-bff5-465c-8a57-e53aca53ef5e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:18.998001 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a0e61667-bff5-465c-8a57-e53aca53ef5e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.066489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a0e61667-bff5-465c-8a57-e53aca53ef5e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:19.068106 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-02c27aab-9a7f-4d98-a401-01b99cab5b7c req-fef098d5-5d00-4a8b-95b4-2913d0bedb3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b28b5c17-0afa-4fff-a814-653688b1231b", "tag": "ea5f3186-99cf-44d9-91d3-f823d8b73573"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:19.074396 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a0e61667-bff5-465c-8a57-e53aca53ef5e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.090080 Aug 29 19:08:19.074967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 48/92] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:18 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:19.079353 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0766b2f3-b649-48c1-8a9a-b02900489909 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:19.079957 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0766b2f3-b649-48c1-8a9a-b02900489909 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:19.080329 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-02c27aab-9a7f-4d98-a401-01b99cab5b7c req-fef098d5-5d00-4a8b-95b4-2913d0bedb3c service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:19.080805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-02c27aab-9a7f-4d98-a401-01b99cab5b7c req-fef098d5-5d00-4a8b-95b4-2913d0bedb3c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:19.081226 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-02c27aab-9a7f-4d98-a401-01b99cab5b7c req-fef098d5-5d00-4a8b-95b4-2913d0bedb3c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.086196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0766b2f3-b649-48c1-8a9a-b02900489909 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:19.086684 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0766b2f3-b649-48c1-8a9a-b02900489909 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:19.087144 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0766b2f3-b649-48c1-8a9a-b02900489909 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.087839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0766b2f3-b649-48c1-8a9a-b02900489909 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:19.088296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0766b2f3-b649-48c1-8a9a-b02900489909 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:19.088718 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0766b2f3-b649-48c1-8a9a-b02900489909 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.101790 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-02c27aab-9a7f-4d98-a401-01b99cab5b7c req-fef098d5-5d00-4a8b-95b4-2913d0bedb3c service nova] Creating event network-changed:ea5f3186-99cf-44d9-91d3-f823d8b73573 for instance b28b5c17-0afa-4fff-a814-653688b1231b on hv-cinder-73126 Aug 29 19:08:19.102578 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-02c27aab-9a7f-4d98-a401-01b99cab5b7c req-fef098d5-5d00-4a8b-95b4-2913d0bedb3c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=115968) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 19:08:19.102981 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-02c27aab-9a7f-4d98-a401-01b99cab5b7c req-fef098d5-5d00-4a8b-95b4-2913d0bedb3c service nova] Acquired lock "compute-rpcapi-router" {{(pid=115968) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 19:08:19.104038 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a77709e-8c15-472e-a0b2-4ffeb27cdedc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:19.104500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a77709e-8c15-472e-a0b2-4ffeb27cdedc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:19.104923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a77709e-8c15-472e-a0b2-4ffeb27cdedc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.105629 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a77709e-8c15-472e-a0b2-4ffeb27cdedc None None] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:19.106080 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a77709e-8c15-472e-a0b2-4ffeb27cdedc None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:19.106494 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a77709e-8c15-472e-a0b2-4ffeb27cdedc None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.115694 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.compute.rpcapi [None req-0a77709e-8c15-472e-a0b2-4ffeb27cdedc None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 19:08:19.117181 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a77709e-8c15-472e-a0b2-4ffeb27cdedc None None] Releasing lock "compute-rpcapi-router" {{(pid=115968) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 19:08:19.135748 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0a77709e-8c15-472e-a0b2-4ffeb27cdedc None None] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130775 Aug 29 19:08:19.136623 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 45/93] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:08:19.153767 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0766b2f3-b649-48c1-8a9a-b02900489909 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:19.162445 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0766b2f3-b649-48c1-8a9a-b02900489909 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.086515 Aug 29 19:08:19.163005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 49/94] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:19 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:19.280889 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:19.281578 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:19.287737 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:19.288218 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:19.288653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.289332 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:19.289784 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:19.290208 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.352238 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:19.360117 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:19.361545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:19.362619 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f2720d16-f5f5-4d71-8e03-210696594ec8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.086274 Aug 29 19:08:19.363192 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 46/95] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:19 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:19.613656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-24411f81-50e6-4d9e-a0d4-ff73b7e53b03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:19.614823 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-24411f81-50e6-4d9e-a0d4-ff73b7e53b03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:19.620949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24411f81-50e6-4d9e-a0d4-ff73b7e53b03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:19.621425 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24411f81-50e6-4d9e-a0d4-ff73b7e53b03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:19.621851 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24411f81-50e6-4d9e-a0d4-ff73b7e53b03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.622524 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24411f81-50e6-4d9e-a0d4-ff73b7e53b03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:19.622973 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24411f81-50e6-4d9e-a0d4-ff73b7e53b03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:19.623411 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24411f81-50e6-4d9e-a0d4-ff73b7e53b03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.688036 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-24411f81-50e6-4d9e-a0d4-ff73b7e53b03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:19.695640 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-24411f81-50e6-4d9e-a0d4-ff73b7e53b03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1279 microversion: 2.1 time: 0.085793 Aug 29 19:08:19.696203 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 50/96] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:19 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:19.920085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f765a6fc-00ec-46d4-9836-a8436955674c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:19.920692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f765a6fc-00ec-46d4-9836-a8436955674c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:19.926656 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f765a6fc-00ec-46d4-9836-a8436955674c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:19.927181 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f765a6fc-00ec-46d4-9836-a8436955674c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:19.927618 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f765a6fc-00ec-46d4-9836-a8436955674c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.928335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f765a6fc-00ec-46d4-9836-a8436955674c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:19.928988 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f765a6fc-00ec-46d4-9836-a8436955674c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:19.929414 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f765a6fc-00ec-46d4-9836-a8436955674c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:19.992638 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f765a6fc-00ec-46d4-9836-a8436955674c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:20.000265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f765a6fc-00ec-46d4-9836-a8436955674c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1284 microversion: 2.1 time: 0.084002 Aug 29 19:08:20.000826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 47/97] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:19 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:20.094685 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f2d68b62-a476-475c-a97b-9a7b16a5972c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:20.095306 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f2d68b62-a476-475c-a97b-9a7b16a5972c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:20.102272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2d68b62-a476-475c-a97b-9a7b16a5972c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:20.102746 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2d68b62-a476-475c-a97b-9a7b16a5972c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:20.103205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2d68b62-a476-475c-a97b-9a7b16a5972c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:20.103885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2d68b62-a476-475c-a97b-9a7b16a5972c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:20.104330 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2d68b62-a476-475c-a97b-9a7b16a5972c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:20.104744 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2d68b62-a476-475c-a97b-9a7b16a5972c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:20.165198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f2d68b62-a476-475c-a97b-9a7b16a5972c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:20.172871 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f2d68b62-a476-475c-a97b-9a7b16a5972c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.081999 Aug 29 19:08:20.173453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 51/98] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:20 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:20.183137 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fdd53614-2984-4651-ad52-10ff2bc2af03 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:20.183748 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fdd53614-2984-4651-ad52-10ff2bc2af03 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:20.189669 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fdd53614-2984-4651-ad52-10ff2bc2af03 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:20.190162 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fdd53614-2984-4651-ad52-10ff2bc2af03 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:20.190573 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fdd53614-2984-4651-ad52-10ff2bc2af03 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:20.191279 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fdd53614-2984-4651-ad52-10ff2bc2af03 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:20.191727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fdd53614-2984-4651-ad52-10ff2bc2af03 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:20.192143 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fdd53614-2984-4651-ad52-10ff2bc2af03 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:20.254875 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fdd53614-2984-4651-ad52-10ff2bc2af03 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:20.263054 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fdd53614-2984-4651-ad52-10ff2bc2af03 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.083963 Aug 29 19:08:20.263642 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 48/99] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:20 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:20.385953 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:20.386559 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:20.392556 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:20.393032 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:20.393458 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:20.394134 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:20.394580 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:20.394999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:20.455031 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:20.463868 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:20.465308 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:20.466400 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-768d3f54-5102-4f08-92b1-7750e0e2b07d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1332 microversion: 2.20 time: 0.084989 Aug 29 19:08:20.466956 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 52/100] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:20 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1332 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:20.725009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b063e485-5b9e-424d-89b2-933252198c3e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:20.725009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b063e485-5b9e-424d-89b2-933252198c3e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:20.725501 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b063e485-5b9e-424d-89b2-933252198c3e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:20.726026 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b063e485-5b9e-424d-89b2-933252198c3e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:20.726951 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b063e485-5b9e-424d-89b2-933252198c3e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:20.727178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b063e485-5b9e-424d-89b2-933252198c3e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:20.727636 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b063e485-5b9e-424d-89b2-933252198c3e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:20.728060 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b063e485-5b9e-424d-89b2-933252198c3e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:20.796144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b063e485-5b9e-424d-89b2-933252198c3e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:20.803816 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b063e485-5b9e-424d-89b2-933252198c3e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1279 microversion: 2.1 time: 0.090770 Aug 29 19:08:20.804972 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 49/101] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:20 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:21.022588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7f0d4403-affb-4ff2-bf29-2bafa4a4b232 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:21.023488 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7f0d4403-affb-4ff2-bf29-2bafa4a4b232 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:21.033416 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f0d4403-affb-4ff2-bf29-2bafa4a4b232 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:21.033951 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f0d4403-affb-4ff2-bf29-2bafa4a4b232 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:21.034443 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f0d4403-affb-4ff2-bf29-2bafa4a4b232 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:21.035624 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f0d4403-affb-4ff2-bf29-2bafa4a4b232 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:21.036965 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f0d4403-affb-4ff2-bf29-2bafa4a4b232 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:21.037549 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f0d4403-affb-4ff2-bf29-2bafa4a4b232 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:21.194144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-23862ea5-a9a6-4bc1-870c-cd34f477e755 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:21.195840 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-23862ea5-a9a6-4bc1-870c-cd34f477e755 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:21.209698 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23862ea5-a9a6-4bc1-870c-cd34f477e755 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:21.210930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23862ea5-a9a6-4bc1-870c-cd34f477e755 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:21.214524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23862ea5-a9a6-4bc1-870c-cd34f477e755 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:21.215452 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23862ea5-a9a6-4bc1-870c-cd34f477e755 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:21.216056 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23862ea5-a9a6-4bc1-870c-cd34f477e755 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:21.216621 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23862ea5-a9a6-4bc1-870c-cd34f477e755 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:21.247413 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7f0d4403-affb-4ff2-bf29-2bafa4a4b232 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:21.263718 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7f0d4403-affb-4ff2-bf29-2bafa4a4b232 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1272 microversion: 2.1 time: 0.244116 Aug 29 19:08:21.269059 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 53/102] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:21 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1272 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:21.284543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-944d4daa-2730-4b16-92f5-b045451af0ae tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:21.285213 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-944d4daa-2730-4b16-92f5-b045451af0ae tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:21.296853 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-944d4daa-2730-4b16-92f5-b045451af0ae tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:21.298394 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-944d4daa-2730-4b16-92f5-b045451af0ae tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:21.299089 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-944d4daa-2730-4b16-92f5-b045451af0ae tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:21.301904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-944d4daa-2730-4b16-92f5-b045451af0ae tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:21.301904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-944d4daa-2730-4b16-92f5-b045451af0ae tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:21.301904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-944d4daa-2730-4b16-92f5-b045451af0ae tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:21.332037 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-23862ea5-a9a6-4bc1-870c-cd34f477e755 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:21.376453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-23862ea5-a9a6-4bc1-870c-cd34f477e755 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1294 microversion: 2.1 time: 0.183377 Aug 29 19:08:21.391932 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 50/103] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:21 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1294 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:21.489165 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:21.489816 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:21.496926 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:21.497653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:21.498181 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:21.498941 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:21.499482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:21.499930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:21.872852 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-944d4daa-2730-4b16-92f5-b045451af0ae tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:21.883361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-944d4daa-2730-4b16-92f5-b045451af0ae tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1290 microversion: 2.1 time: 0.603067 Aug 29 19:08:21.886720 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 54/104] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:21 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1290 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:21.897537 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1ee3a516-c9ee-40ac-9a3c-a5b0a9f0ff78 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:21.900448 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1ee3a516-c9ee-40ac-9a3c-a5b0a9f0ff78 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:21.917988 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ee3a516-c9ee-40ac-9a3c-a5b0a9f0ff78 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:21.920431 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ee3a516-c9ee-40ac-9a3c-a5b0a9f0ff78 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:21.922002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ee3a516-c9ee-40ac-9a3c-a5b0a9f0ff78 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:21.924910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ee3a516-c9ee-40ac-9a3c-a5b0a9f0ff78 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:21.925433 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ee3a516-c9ee-40ac-9a3c-a5b0a9f0ff78 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:21.925907 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ee3a516-c9ee-40ac-9a3c-a5b0a9f0ff78 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:22.159909 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:22.170641 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:22.172664 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:22.174163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ce037156-d81f-4bba-be99-ebc756c1c673 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1338 microversion: 2.20 time: 0.689053 Aug 29 19:08:22.175778 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 51/105] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:21 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1338 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:08:22.201422 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1ee3a516-c9ee-40ac-9a3c-a5b0a9f0ff78 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:22.211995 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1ee3a516-c9ee-40ac-9a3c-a5b0a9f0ff78 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1279 microversion: 2.1 time: 0.322486 Aug 29 19:08:22.213849 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 55/106] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:21 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1279 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:22.295049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-589c5afe-0f8c-4295-b394-77634a59ebe8 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:22.296029 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-589c5afe-0f8c-4295-b394-77634a59ebe8 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:22.304355 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589c5afe-0f8c-4295-b394-77634a59ebe8 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:22.305142 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589c5afe-0f8c-4295-b394-77634a59ebe8 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:22.305732 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589c5afe-0f8c-4295-b394-77634a59ebe8 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:22.306614 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589c5afe-0f8c-4295-b394-77634a59ebe8 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:22.307095 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589c5afe-0f8c-4295-b394-77634a59ebe8 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:22.307739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589c5afe-0f8c-4295-b394-77634a59ebe8 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:22.402000 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8ef2c70d-7ea3-4247-8095-e860655e3ee7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:22.402774 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8ef2c70d-7ea3-4247-8095-e860655e3ee7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:22.420100 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ef2c70d-7ea3-4247-8095-e860655e3ee7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:22.420691 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ef2c70d-7ea3-4247-8095-e860655e3ee7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:22.421133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ef2c70d-7ea3-4247-8095-e860655e3ee7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:22.421863 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ef2c70d-7ea3-4247-8095-e860655e3ee7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:22.422313 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ef2c70d-7ea3-4247-8095-e860655e3ee7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:22.422729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ef2c70d-7ea3-4247-8095-e860655e3ee7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:22.573199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8ef2c70d-7ea3-4247-8095-e860655e3ee7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:22.603979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8ef2c70d-7ea3-4247-8095-e860655e3ee7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1300 microversion: 2.1 time: 0.208111 Aug 29 19:08:22.605254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 56/107] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:22 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1300 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:22.871924 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-589c5afe-0f8c-4295-b394-77634a59ebe8 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:22.889776 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-589c5afe-0f8c-4295-b394-77634a59ebe8 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.598680 Aug 29 19:08:22.893555 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 52/108] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:22 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:22.906334 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-80d14803-0471-41c9-b6ff-daa8c787eaaf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:22.907171 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-80d14803-0471-41c9-b6ff-daa8c787eaaf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:22.916480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80d14803-0471-41c9-b6ff-daa8c787eaaf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:22.917603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80d14803-0471-41c9-b6ff-daa8c787eaaf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:22.917603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80d14803-0471-41c9-b6ff-daa8c787eaaf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:22.918387 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80d14803-0471-41c9-b6ff-daa8c787eaaf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:22.918905 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80d14803-0471-41c9-b6ff-daa8c787eaaf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:22.919601 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80d14803-0471-41c9-b6ff-daa8c787eaaf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:23.112260 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-80d14803-0471-41c9-b6ff-daa8c787eaaf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:23.135135 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-80d14803-0471-41c9-b6ff-daa8c787eaaf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1296 microversion: 2.1 time: 0.232624 Aug 29 19:08:23.135759 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 57/109] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:22 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1296 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:23.203061 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:23.206333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:23.217108 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:23.218131 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:23.218560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:23.222938 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:23.223781 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:23.225055 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:23.237166 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-04cda124-43d4-44bb-8b80-1788a7c79e17 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:23.237879 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-04cda124-43d4-44bb-8b80-1788a7c79e17 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:23.261146 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-04cda124-43d4-44bb-8b80-1788a7c79e17 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:23.261666 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-04cda124-43d4-44bb-8b80-1788a7c79e17 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:23.262107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-04cda124-43d4-44bb-8b80-1788a7c79e17 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:23.267191 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-04cda124-43d4-44bb-8b80-1788a7c79e17 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:23.268332 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-04cda124-43d4-44bb-8b80-1788a7c79e17 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:23.271690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-04cda124-43d4-44bb-8b80-1788a7c79e17 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:23.548511 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:23.558315 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:23.560301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:23.561582 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-749caf1f-5e69-4e89-8bc4-0200f676f095 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1338 microversion: 2.20 time: 0.368202 Aug 29 19:08:23.562521 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 53/110] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:23 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1338 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:23.627654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b08fe95d-2b11-44a6-a749-7aff13c12e2e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:23.628433 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b08fe95d-2b11-44a6-a749-7aff13c12e2e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:23.639357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b08fe95d-2b11-44a6-a749-7aff13c12e2e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:23.643657 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b08fe95d-2b11-44a6-a749-7aff13c12e2e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:23.644735 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b08fe95d-2b11-44a6-a749-7aff13c12e2e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:23.645600 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b08fe95d-2b11-44a6-a749-7aff13c12e2e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:23.646143 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b08fe95d-2b11-44a6-a749-7aff13c12e2e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:23.646871 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b08fe95d-2b11-44a6-a749-7aff13c12e2e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:23.789374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b08fe95d-2b11-44a6-a749-7aff13c12e2e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:23.801450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b08fe95d-2b11-44a6-a749-7aff13c12e2e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1300 microversion: 2.1 time: 0.178803 Aug 29 19:08:23.802586 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 54/111] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:23 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:23.916954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ad833734-4131-4ad2-b8fd-9c8555b388d7 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:23.917738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ad833734-4131-4ad2-b8fd-9c8555b388d7 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:23.924545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad833734-4131-4ad2-b8fd-9c8555b388d7 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:23.925745 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad833734-4131-4ad2-b8fd-9c8555b388d7 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:23.926461 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad833734-4131-4ad2-b8fd-9c8555b388d7 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:23.927513 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad833734-4131-4ad2-b8fd-9c8555b388d7 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:23.928187 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad833734-4131-4ad2-b8fd-9c8555b388d7 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:23.930225 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad833734-4131-4ad2-b8fd-9c8555b388d7 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:24.358989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-04cda124-43d4-44bb-8b80-1788a7c79e17 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:24.362410 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:24.374054 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-04cda124-43d4-44bb-8b80-1788a7c79e17 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 1.142141 Aug 29 19:08:24.374901 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 58/112] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:23 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:24.391829 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-619fd93b-dae1-4d26-b0be-0553f017fed5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:24.392602 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-619fd93b-dae1-4d26-b0be-0553f017fed5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:24.412406 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-619fd93b-dae1-4d26-b0be-0553f017fed5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:24.412708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-619fd93b-dae1-4d26-b0be-0553f017fed5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:24.413499 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-619fd93b-dae1-4d26-b0be-0553f017fed5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:24.417040 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-619fd93b-dae1-4d26-b0be-0553f017fed5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:24.417705 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-619fd93b-dae1-4d26-b0be-0553f017fed5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:24.420587 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-619fd93b-dae1-4d26-b0be-0553f017fed5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:24.816059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ad833734-4131-4ad2-b8fd-9c8555b388d7 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:24.828207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ad833734-4131-4ad2-b8fd-9c8555b388d7 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.915993 Aug 29 19:08:24.859035 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 55/113] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:23 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:24.875130 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:24.876209 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:24.917409 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:24.917977 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:24.918504 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:24.919112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:24.919587 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:24.927579 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:25.106241 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:25.126062 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:25.127548 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-619fd93b-dae1-4d26-b0be-0553f017fed5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:25.129968 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:25.131438 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c032499c-00ab-475a-b9ee-6250a8970e0d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1338 microversion: 2.20 time: 0.269170 Aug 29 19:08:25.132273 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 56/114] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:24 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1338 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:25.137310 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-619fd93b-dae1-4d26-b0be-0553f017fed5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.754971 Aug 29 19:08:25.137897 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 59/115] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:24 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:25.145025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5f2cf46e-06b8-4236-bf45-82116305387b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:25.145781 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5f2cf46e-06b8-4236-bf45-82116305387b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:25.165491 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5f2cf46e-06b8-4236-bf45-82116305387b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:25.166886 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5f2cf46e-06b8-4236-bf45-82116305387b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:25.167674 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5f2cf46e-06b8-4236-bf45-82116305387b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:25.168583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5f2cf46e-06b8-4236-bf45-82116305387b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:25.169191 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5f2cf46e-06b8-4236-bf45-82116305387b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:25.169641 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5f2cf46e-06b8-4236-bf45-82116305387b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:25.299787 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-f006c353-79f0-4dd3-a7db-576a7a3404c5 req-fd771175-963d-40ff-87db-bc9b9d27370f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f5cf3f-d9c5-4279-a896-d6dd9c50266a", "tag": "284ef1b6-7701-4493-93a6-1161589f2769"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:25.310790 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-f006c353-79f0-4dd3-a7db-576a7a3404c5 req-fd771175-963d-40ff-87db-bc9b9d27370f service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:25.311312 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-f006c353-79f0-4dd3-a7db-576a7a3404c5 req-fd771175-963d-40ff-87db-bc9b9d27370f service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:25.311777 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-f006c353-79f0-4dd3-a7db-576a7a3404c5 req-fd771175-963d-40ff-87db-bc9b9d27370f service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:25.315945 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:25.325574 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-f006c353-79f0-4dd3-a7db-576a7a3404c5 req-fd771175-963d-40ff-87db-bc9b9d27370f service nova] Creating event network-changed:284ef1b6-7701-4493-93a6-1161589f2769 for instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a on hv-cinder-73126 Aug 29 19:08:25.332117 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-f006c353-79f0-4dd3-a7db-576a7a3404c5 req-fd771175-963d-40ff-87db-bc9b9d27370f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197786 Aug 29 19:08:25.333262 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 57/116] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:25.398730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-85ee590c-d933-4f82-99c9-768ed33fb653 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:25.399593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-85ee590c-d933-4f82-99c9-768ed33fb653 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:25.406468 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85ee590c-d933-4f82-99c9-768ed33fb653 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:25.406965 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85ee590c-d933-4f82-99c9-768ed33fb653 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:25.407428 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85ee590c-d933-4f82-99c9-768ed33fb653 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:25.408131 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85ee590c-d933-4f82-99c9-768ed33fb653 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:25.408584 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85ee590c-d933-4f82-99c9-768ed33fb653 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:25.409006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85ee590c-d933-4f82-99c9-768ed33fb653 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:25.711275 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5f2cf46e-06b8-4236-bf45-82116305387b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:25.729829 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5f2cf46e-06b8-4236-bf45-82116305387b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.588725 Aug 29 19:08:25.730497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 60/117] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:25 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:25.794641 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-85ee590c-d933-4f82-99c9-768ed33fb653 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:25.821817 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-85ee590c-d933-4f82-99c9-768ed33fb653 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.424136 Aug 29 19:08:25.822494 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 58/118] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:25 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:25.878163 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-52941c16-3a2e-4a85-bf41-6edd0165a4a3 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:25.879053 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-52941c16-3a2e-4a85-bf41-6edd0165a4a3 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:25.887016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52941c16-3a2e-4a85-bf41-6edd0165a4a3 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:25.887793 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52941c16-3a2e-4a85-bf41-6edd0165a4a3 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:25.888466 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52941c16-3a2e-4a85-bf41-6edd0165a4a3 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:25.889423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52941c16-3a2e-4a85-bf41-6edd0165a4a3 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:25.890087 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52941c16-3a2e-4a85-bf41-6edd0165a4a3 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:25.890731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52941c16-3a2e-4a85-bf41-6edd0165a4a3 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:26.115323 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-c64aa8b8-0ff3-452a-b15c-45c889156c2f req-2017cf9d-4a3c-43e0-b4b4-5b782ab880bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0792b7a2-491c-41dc-b356-6116396636b7", "tag": "2773a328-c32b-4251-884e-1d7401f1853a"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:26.133606 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-c64aa8b8-0ff3-452a-b15c-45c889156c2f req-2017cf9d-4a3c-43e0-b4b4-5b782ab880bb service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:26.138918 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-c64aa8b8-0ff3-452a-b15c-45c889156c2f req-2017cf9d-4a3c-43e0-b4b4-5b782ab880bb service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:26.139401 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-c64aa8b8-0ff3-452a-b15c-45c889156c2f req-2017cf9d-4a3c-43e0-b4b4-5b782ab880bb service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:26.166133 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-c64aa8b8-0ff3-452a-b15c-45c889156c2f req-2017cf9d-4a3c-43e0-b4b4-5b782ab880bb service nova] Creating event network-changed:2773a328-c32b-4251-884e-1d7401f1853a for instance 0792b7a2-491c-41dc-b356-6116396636b7 on hv-cinder-73126 Aug 29 19:08:26.172049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-c64aa8b8-0ff3-452a-b15c-45c889156c2f req-2017cf9d-4a3c-43e0-b4b4-5b782ab880bb service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060678 Aug 29 19:08:26.173145 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 59/119] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:26.180298 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:26.181483 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:26.188286 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:26.188854 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:26.189281 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:26.189977 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:26.190423 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:26.190835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:26.216943 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-52941c16-3a2e-4a85-bf41-6edd0165a4a3 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:26.239555 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-52941c16-3a2e-4a85-bf41-6edd0165a4a3 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.365466 Aug 29 19:08:26.240155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 61/120] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:25 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:26.250115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d46d36ef-e74b-45c6-9c09-2491097e3fe1 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:26.251016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d46d36ef-e74b-45c6-9c09-2491097e3fe1 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:26.274166 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d46d36ef-e74b-45c6-9c09-2491097e3fe1 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:26.274584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d46d36ef-e74b-45c6-9c09-2491097e3fe1 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:26.275036 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d46d36ef-e74b-45c6-9c09-2491097e3fe1 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:26.280865 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d46d36ef-e74b-45c6-9c09-2491097e3fe1 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:26.282549 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d46d36ef-e74b-45c6-9c09-2491097e3fe1 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:26.283007 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d46d36ef-e74b-45c6-9c09-2491097e3fe1 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:26.510818 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:26.523420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:26.525145 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:26.526282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c7ce6a96-d4ae-47a8-bcfb-8adc404ac9bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.351920 Aug 29 19:08:26.531606 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 60/121] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:26 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:26.751652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-04a179d9-a3d5-4413-84c0-a44f8cb97db0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:26.752157 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-04a179d9-a3d5-4413-84c0-a44f8cb97db0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:26.760748 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-04a179d9-a3d5-4413-84c0-a44f8cb97db0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:26.761256 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-04a179d9-a3d5-4413-84c0-a44f8cb97db0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:26.761687 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-04a179d9-a3d5-4413-84c0-a44f8cb97db0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:26.762407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-04a179d9-a3d5-4413-84c0-a44f8cb97db0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:26.768751 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-04a179d9-a3d5-4413-84c0-a44f8cb97db0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:26.769384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-04a179d9-a3d5-4413-84c0-a44f8cb97db0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:26.792590 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d46d36ef-e74b-45c6-9c09-2491097e3fe1 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:26.809880 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d46d36ef-e74b-45c6-9c09-2491097e3fe1 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.566586 Aug 29 19:08:26.810857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 62/122] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:26 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:26.843801 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-05c6945c-e33b-44d4-9891-36d9dfc88047 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:26.844956 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-05c6945c-e33b-44d4-9891-36d9dfc88047 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:26.869789 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c6945c-e33b-44d4-9891-36d9dfc88047 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:26.870527 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c6945c-e33b-44d4-9891-36d9dfc88047 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:26.871616 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c6945c-e33b-44d4-9891-36d9dfc88047 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:26.872690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c6945c-e33b-44d4-9891-36d9dfc88047 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:26.873355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c6945c-e33b-44d4-9891-36d9dfc88047 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:26.874645 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c6945c-e33b-44d4-9891-36d9dfc88047 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:27.562384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-04a179d9-a3d5-4413-84c0-a44f8cb97db0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:27.587827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-04a179d9-a3d5-4413-84c0-a44f8cb97db0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.839775 Aug 29 19:08:27.589187 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 61/123] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:26 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:27.600980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-46460778-53b1-4fc9-b3a5-b8e6bf681128 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:27.602549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-46460778-53b1-4fc9-b3a5-b8e6bf681128 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:27.604600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-05c6945c-e33b-44d4-9891-36d9dfc88047 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:27.623758 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-05c6945c-e33b-44d4-9891-36d9dfc88047 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.776145 Aug 29 19:08:27.623758 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 63/124] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:26 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:27.633727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46460778-53b1-4fc9-b3a5-b8e6bf681128 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:27.634284 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46460778-53b1-4fc9-b3a5-b8e6bf681128 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:27.634721 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46460778-53b1-4fc9-b3a5-b8e6bf681128 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:27.635933 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46460778-53b1-4fc9-b3a5-b8e6bf681128 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:27.637545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46460778-53b1-4fc9-b3a5-b8e6bf681128 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:27.637982 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46460778-53b1-4fc9-b3a5-b8e6bf681128 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:27.655271 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-65447a27-49eb-4d9f-b66f-d77dc0edcb1e req-3a358f84-992d-456b-ba86-932effe304e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f96567-e842-4352-9e40-e31d2f547937", "tag": "2d38d71d-cc1e-42fd-b291-eb339787cf57"}, {"name": "network-changed", "server_uuid": "3f54a0ab-56bd-45b7-9026-0c998c315879", "tag": "2fadd321-bdd6-4593-985e-4b08308c8b84"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:27.677528 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-65447a27-49eb-4d9f-b66f-d77dc0edcb1e req-3a358f84-992d-456b-ba86-932effe304e4 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:27.678076 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-65447a27-49eb-4d9f-b66f-d77dc0edcb1e req-3a358f84-992d-456b-ba86-932effe304e4 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:27.678679 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-65447a27-49eb-4d9f-b66f-d77dc0edcb1e req-3a358f84-992d-456b-ba86-932effe304e4 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:27.730119 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-65447a27-49eb-4d9f-b66f-d77dc0edcb1e req-3a358f84-992d-456b-ba86-932effe304e4 service nova] Creating event network-changed:2d38d71d-cc1e-42fd-b291-eb339787cf57 for instance 22f96567-e842-4352-9e40-e31d2f547937 on hv-cinder-73126 Aug 29 19:08:27.730906 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-65447a27-49eb-4d9f-b66f-d77dc0edcb1e req-3a358f84-992d-456b-ba86-932effe304e4 service nova] Creating event network-changed:2fadd321-bdd6-4593-985e-4b08308c8b84 for instance 3f54a0ab-56bd-45b7-9026-0c998c315879 on hv-cinder-73126 Aug 29 19:08:27.731639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-65447a27-49eb-4d9f-b66f-d77dc0edcb1e req-3a358f84-992d-456b-ba86-932effe304e4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=115967) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 19:08:27.732194 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-65447a27-49eb-4d9f-b66f-d77dc0edcb1e req-3a358f84-992d-456b-ba86-932effe304e4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=115967) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 19:08:27.734527 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69eca570-995d-4483-aa40-67eae3b039ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:27.736596 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69eca570-995d-4483-aa40-67eae3b039ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:27.737234 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69eca570-995d-4483-aa40-67eae3b039ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:27.739537 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69eca570-995d-4483-aa40-67eae3b039ba None None] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:27.743287 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69eca570-995d-4483-aa40-67eae3b039ba None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:27.743919 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69eca570-995d-4483-aa40-67eae3b039ba None None] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:27.756879 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.compute.rpcapi [None req-69eca570-995d-4483-aa40-67eae3b039ba None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 19:08:27.758155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69eca570-995d-4483-aa40-67eae3b039ba None None] Releasing lock "compute-rpcapi-router" {{(pid=115967) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 19:08:27.777854 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-69eca570-995d-4483-aa40-67eae3b039ba None None] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.136417 Aug 29 19:08:27.778507 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 64/125] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:27.786351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:27.787454 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:27.796850 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:27.797453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:27.797773 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:27.803381 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:27.803987 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:27.805147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:27.903838 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-46460778-53b1-4fc9-b3a5-b8e6bf681128 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:27.913334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-46460778-53b1-4fc9-b3a5-b8e6bf681128 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.321898 Aug 29 19:08:27.914592 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 62/126] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:27 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:27.921983 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ab5b5e27-f2ea-40c5-a923-c15b9520f738 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:27.922701 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ab5b5e27-f2ea-40c5-a923-c15b9520f738 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:27.930668 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ab5b5e27-f2ea-40c5-a923-c15b9520f738 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:27.931378 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ab5b5e27-f2ea-40c5-a923-c15b9520f738 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:27.931954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ab5b5e27-f2ea-40c5-a923-c15b9520f738 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:27.932786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ab5b5e27-f2ea-40c5-a923-c15b9520f738 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:27.933389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ab5b5e27-f2ea-40c5-a923-c15b9520f738 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:27.933949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ab5b5e27-f2ea-40c5-a923-c15b9520f738 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:28.149383 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:28.166033 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:28.167945 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:28.170608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2860f693-8e7c-40d7-bcd2-8d6b2733085c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.389742 Aug 29 19:08:28.173866 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 65/127] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:27 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:28.311604 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ab5b5e27-f2ea-40c5-a923-c15b9520f738 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:28.322818 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ab5b5e27-f2ea-40c5-a923-c15b9520f738 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.406675 Aug 29 19:08:28.324525 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 63/128] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:27 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:28.379277 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-d18efeba-0fde-41cc-b7a7-b139c1ca0340 req-f2df0502-d6bb-4201-b1f0-e05a6f355b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4696f764-f3e7-482f-b94e-549896198ddf", "tag": "90bec49f-36b1-4027-8fc3-86cd4d15e3f4"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:28.416211 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-d18efeba-0fde-41cc-b7a7-b139c1ca0340 req-f2df0502-d6bb-4201-b1f0-e05a6f355b79 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:28.417180 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-d18efeba-0fde-41cc-b7a7-b139c1ca0340 req-f2df0502-d6bb-4201-b1f0-e05a6f355b79 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:28.418474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-d18efeba-0fde-41cc-b7a7-b139c1ca0340 req-f2df0502-d6bb-4201-b1f0-e05a6f355b79 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:28.446714 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-d18efeba-0fde-41cc-b7a7-b139c1ca0340 req-f2df0502-d6bb-4201-b1f0-e05a6f355b79 service nova] Creating event network-changed:90bec49f-36b1-4027-8fc3-86cd4d15e3f4 for instance 4696f764-f3e7-482f-b94e-549896198ddf on hv-cinder-73126 Aug 29 19:08:28.452962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-d18efeba-0fde-41cc-b7a7-b139c1ca0340 req-f2df0502-d6bb-4201-b1f0-e05a6f355b79 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084328 Aug 29 19:08:28.454338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 66/129] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:28.611567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-820a6f0e-23ad-402e-8c87-ff21e9ea1827 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:28.612508 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-820a6f0e-23ad-402e-8c87-ff21e9ea1827 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:28.619574 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-820a6f0e-23ad-402e-8c87-ff21e9ea1827 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:28.620374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-820a6f0e-23ad-402e-8c87-ff21e9ea1827 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:28.620875 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-820a6f0e-23ad-402e-8c87-ff21e9ea1827 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:28.621771 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-820a6f0e-23ad-402e-8c87-ff21e9ea1827 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:28.622609 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-820a6f0e-23ad-402e-8c87-ff21e9ea1827 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:28.623297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-820a6f0e-23ad-402e-8c87-ff21e9ea1827 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:28.639583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fe05c8bb-7473-4ba9-8d2a-c54bd5a766fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:28.640788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fe05c8bb-7473-4ba9-8d2a-c54bd5a766fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:28.649024 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe05c8bb-7473-4ba9-8d2a-c54bd5a766fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:28.649550 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe05c8bb-7473-4ba9-8d2a-c54bd5a766fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:28.658296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe05c8bb-7473-4ba9-8d2a-c54bd5a766fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:28.659692 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe05c8bb-7473-4ba9-8d2a-c54bd5a766fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:28.660168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe05c8bb-7473-4ba9-8d2a-c54bd5a766fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:28.660794 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe05c8bb-7473-4ba9-8d2a-c54bd5a766fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:28.825193 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-820a6f0e-23ad-402e-8c87-ff21e9ea1827 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:28.844027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-820a6f0e-23ad-402e-8c87-ff21e9ea1827 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.236247 Aug 29 19:08:28.857303 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 64/130] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:28 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:28.865259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fe05c8bb-7473-4ba9-8d2a-c54bd5a766fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:28.878113 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fe05c8bb-7473-4ba9-8d2a-c54bd5a766fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.245487 Aug 29 19:08:28.878709 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 67/131] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:28 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:28.935995 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-39763d13-fa68-46f9-b7a6-24f978b68669 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:28.940675 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-39763d13-fa68-46f9-b7a6-24f978b68669 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:28.940675 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:28.946234 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39763d13-fa68-46f9-b7a6-24f978b68669 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:28.946995 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39763d13-fa68-46f9-b7a6-24f978b68669 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:28.947527 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39763d13-fa68-46f9-b7a6-24f978b68669 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:28.948344 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39763d13-fa68-46f9-b7a6-24f978b68669 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:28.948870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39763d13-fa68-46f9-b7a6-24f978b68669 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:28.949388 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39763d13-fa68-46f9-b7a6-24f978b68669 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:29.105074 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-39763d13-fa68-46f9-b7a6-24f978b68669 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:29.111443 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-39763d13-fa68-46f9-b7a6-24f978b68669 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.179930 Aug 29 19:08:29.112542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 65/132] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:28 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:29.200382 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:29.201068 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:29.205319 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:29.213002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:29.213002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:29.213002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:29.213445 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:29.213945 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:29.214422 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:29.345386 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-88eadd44-58f8-4fbe-9f5c-cba41da05c9c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:29.346027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-88eadd44-58f8-4fbe-9f5c-cba41da05c9c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:29.348090 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:29.354810 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-88eadd44-58f8-4fbe-9f5c-cba41da05c9c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:29.355613 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-88eadd44-58f8-4fbe-9f5c-cba41da05c9c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:29.356045 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-88eadd44-58f8-4fbe-9f5c-cba41da05c9c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:29.356915 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-88eadd44-58f8-4fbe-9f5c-cba41da05c9c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:29.357379 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-88eadd44-58f8-4fbe-9f5c-cba41da05c9c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:29.357807 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-88eadd44-58f8-4fbe-9f5c-cba41da05c9c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:29.362761 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:29.371720 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:29.373166 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:29.374274 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c93b783c-5cd0-4b25-861d-83d4394abe8b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.178605 Aug 29 19:08:29.375931 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 68/133] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:29 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:29.497070 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-88eadd44-58f8-4fbe-9f5c-cba41da05c9c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:29.505002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-88eadd44-58f8-4fbe-9f5c-cba41da05c9c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.163578 Aug 29 19:08:29.506080 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 66/134] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:29 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:29.870186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ab6b82d2-779e-4d74-82ed-87d82e01d500 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:29.870821 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ab6b82d2-779e-4d74-82ed-87d82e01d500 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:29.876672 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab6b82d2-779e-4d74-82ed-87d82e01d500 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:29.877178 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab6b82d2-779e-4d74-82ed-87d82e01d500 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:29.877631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab6b82d2-779e-4d74-82ed-87d82e01d500 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:29.878303 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab6b82d2-779e-4d74-82ed-87d82e01d500 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:29.878754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab6b82d2-779e-4d74-82ed-87d82e01d500 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:29.879235 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab6b82d2-779e-4d74-82ed-87d82e01d500 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:29.900461 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d128c7cb-7e18-4253-88ee-b658d27c4c31 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:29.901078 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d128c7cb-7e18-4253-88ee-b658d27c4c31 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:29.907130 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d128c7cb-7e18-4253-88ee-b658d27c4c31 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:29.907613 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d128c7cb-7e18-4253-88ee-b658d27c4c31 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:29.908040 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d128c7cb-7e18-4253-88ee-b658d27c4c31 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:29.908719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d128c7cb-7e18-4253-88ee-b658d27c4c31 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:29.909167 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d128c7cb-7e18-4253-88ee-b658d27c4c31 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:29.909579 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d128c7cb-7e18-4253-88ee-b658d27c4c31 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:30.078079 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ab6b82d2-779e-4d74-82ed-87d82e01d500 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:30.084635 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d128c7cb-7e18-4253-88ee-b658d27c4c31 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:30.086562 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ab6b82d2-779e-4d74-82ed-87d82e01d500 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.219907 Aug 29 19:08:30.087416 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 69/135] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:29 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:30.093834 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d128c7cb-7e18-4253-88ee-b658d27c4c31 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.197844 Aug 29 19:08:30.094403 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 67/136] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:29 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:30.131811 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-519db33d-bc62-4548-80fe-6acf529dee93 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:30.133027 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-519db33d-bc62-4548-80fe-6acf529dee93 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:30.139217 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-519db33d-bc62-4548-80fe-6acf529dee93 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:30.139704 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-519db33d-bc62-4548-80fe-6acf529dee93 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:30.140141 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-519db33d-bc62-4548-80fe-6acf529dee93 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:30.140823 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-519db33d-bc62-4548-80fe-6acf529dee93 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:30.141276 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-519db33d-bc62-4548-80fe-6acf529dee93 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:30.141696 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-519db33d-bc62-4548-80fe-6acf529dee93 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:30.277474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-519db33d-bc62-4548-80fe-6acf529dee93 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:30.286750 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-519db33d-bc62-4548-80fe-6acf529dee93 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.158730 Aug 29 19:08:30.287690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 70/137] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:30 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:30.398100 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:30.398623 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:30.404924 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:30.405407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:30.405843 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:30.406562 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:30.407022 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:30.407473 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:30.526658 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8a999615-41df-487c-baaa-c563b6bb2ef0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:30.527509 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8a999615-41df-487c-baaa-c563b6bb2ef0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:30.534213 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a999615-41df-487c-baaa-c563b6bb2ef0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:30.534850 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a999615-41df-487c-baaa-c563b6bb2ef0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:30.535438 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a999615-41df-487c-baaa-c563b6bb2ef0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:30.536904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a999615-41df-487c-baaa-c563b6bb2ef0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:30.537476 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a999615-41df-487c-baaa-c563b6bb2ef0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:30.538144 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a999615-41df-487c-baaa-c563b6bb2ef0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:30.539443 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:30.547746 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:30.549198 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:30.550318 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fd208312-71e3-40f8-a35b-e46365e86770 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.156394 Aug 29 19:08:30.550887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 68/138] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:30 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:30.675202 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8a999615-41df-487c-baaa-c563b6bb2ef0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:30.682728 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8a999615-41df-487c-baaa-c563b6bb2ef0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.160768 Aug 29 19:08:30.683358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 71/139] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:30 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:31.108347 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9586feec-ae7e-4aa8-8606-115a936bf139 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:31.112908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9586feec-ae7e-4aa8-8606-115a936bf139 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:31.122804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9586feec-ae7e-4aa8-8606-115a936bf139 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.124127 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-67eb2738-f85b-4173-938d-e6175f86a2f1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:31.124728 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-67eb2738-f85b-4173-938d-e6175f86a2f1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:31.128435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9586feec-ae7e-4aa8-8606-115a936bf139 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.128878 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9586feec-ae7e-4aa8-8606-115a936bf139 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.129585 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9586feec-ae7e-4aa8-8606-115a936bf139 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.130315 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9586feec-ae7e-4aa8-8606-115a936bf139 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.130740 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9586feec-ae7e-4aa8-8606-115a936bf139 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.134961 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67eb2738-f85b-4173-938d-e6175f86a2f1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.135480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67eb2738-f85b-4173-938d-e6175f86a2f1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.135908 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67eb2738-f85b-4173-938d-e6175f86a2f1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.136677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67eb2738-f85b-4173-938d-e6175f86a2f1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.141297 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67eb2738-f85b-4173-938d-e6175f86a2f1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.141732 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67eb2738-f85b-4173-938d-e6175f86a2f1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.557114 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-67eb2738-f85b-4173-938d-e6175f86a2f1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:31.564812 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-67eb2738-f85b-4173-938d-e6175f86a2f1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.454243 Aug 29 19:08:31.565395 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 72/140] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:31 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:31.572295 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b506ad46-099b-4adb-9aeb-3cd55845e789 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:31.572925 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b506ad46-099b-4adb-9aeb-3cd55845e789 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:31.578022 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9586feec-ae7e-4aa8-8606-115a936bf139 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:31.579701 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b506ad46-099b-4adb-9aeb-3cd55845e789 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.580345 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b506ad46-099b-4adb-9aeb-3cd55845e789 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.580846 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b506ad46-099b-4adb-9aeb-3cd55845e789 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.581563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b506ad46-099b-4adb-9aeb-3cd55845e789 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.582016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b506ad46-099b-4adb-9aeb-3cd55845e789 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.582430 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b506ad46-099b-4adb-9aeb-3cd55845e789 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.586190 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9586feec-ae7e-4aa8-8606-115a936bf139 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.481944 Aug 29 19:08:31.587895 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 69/141] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:31 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:31.592637 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:31.593236 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:31.599601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.600087 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.600678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.601977 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.602421 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.602887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.796882 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b506ad46-099b-4adb-9aeb-3cd55845e789 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:31.803107 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:31.806582 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b506ad46-099b-4adb-9aeb-3cd55845e789 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.240120 Aug 29 19:08:31.811990 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:31.813436 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:31.814548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7f1eed15-9df5-47d5-b313-2dceaada156e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.225731 Aug 29 19:08:31.815483 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 70/142] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:31 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:31.819886 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1205f3d3-9f87-4aa7-9726-ba1cd7f5a9d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:31.821359 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1205f3d3-9f87-4aa7-9726-ba1cd7f5a9d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:31.825985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 73/143] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:31 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:31.827488 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1205f3d3-9f87-4aa7-9726-ba1cd7f5a9d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.827976 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1205f3d3-9f87-4aa7-9726-ba1cd7f5a9d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.828409 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1205f3d3-9f87-4aa7-9726-ba1cd7f5a9d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.829096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1205f3d3-9f87-4aa7-9726-ba1cd7f5a9d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:31.829545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1205f3d3-9f87-4aa7-9726-ba1cd7f5a9d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:31.829959 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1205f3d3-9f87-4aa7-9726-ba1cd7f5a9d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:31.971175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1205f3d3-9f87-4aa7-9726-ba1cd7f5a9d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:31.979875 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1205f3d3-9f87-4aa7-9726-ba1cd7f5a9d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.163379 Aug 29 19:08:31.983399 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 71/144] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:31 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:32.587933 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e9767b30-6fe8-443f-9a62-462016b16a24 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:32.589104 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e9767b30-6fe8-443f-9a62-462016b16a24 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:32.595331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9767b30-6fe8-443f-9a62-462016b16a24 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:32.595813 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9767b30-6fe8-443f-9a62-462016b16a24 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:32.596409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9767b30-6fe8-443f-9a62-462016b16a24 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:32.597185 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9767b30-6fe8-443f-9a62-462016b16a24 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:32.597658 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9767b30-6fe8-443f-9a62-462016b16a24 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:32.598330 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9767b30-6fe8-443f-9a62-462016b16a24 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:32.614972 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-58fa75bd-d7bc-4965-b806-9bc135ff439e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:32.616475 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-58fa75bd-d7bc-4965-b806-9bc135ff439e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:32.628639 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-58fa75bd-d7bc-4965-b806-9bc135ff439e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:32.630411 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-58fa75bd-d7bc-4965-b806-9bc135ff439e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:32.631433 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-58fa75bd-d7bc-4965-b806-9bc135ff439e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:32.633356 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-58fa75bd-d7bc-4965-b806-9bc135ff439e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:32.634384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-58fa75bd-d7bc-4965-b806-9bc135ff439e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:32.635200 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-58fa75bd-d7bc-4965-b806-9bc135ff439e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:32.848612 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e9767b30-6fe8-443f-9a62-462016b16a24 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:32.853002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-58fa75bd-d7bc-4965-b806-9bc135ff439e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:32.858867 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e9767b30-6fe8-443f-9a62-462016b16a24 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.275063 Aug 29 19:08:32.859468 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 74/145] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:32 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:32.874947 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-58fa75bd-d7bc-4965-b806-9bc135ff439e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.265201 Aug 29 19:08:32.875659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 72/146] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:32 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:32.879681 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b108738a-693e-47c7-9baa-d5bdfb2f346d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:32.880738 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b108738a-693e-47c7-9baa-d5bdfb2f346d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:32.889180 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b108738a-693e-47c7-9baa-d5bdfb2f346d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:32.889992 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b108738a-693e-47c7-9baa-d5bdfb2f346d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:32.890597 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b108738a-693e-47c7-9baa-d5bdfb2f346d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:32.891762 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b108738a-693e-47c7-9baa-d5bdfb2f346d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:32.892375 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b108738a-693e-47c7-9baa-d5bdfb2f346d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:32.893295 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b108738a-693e-47c7-9baa-d5bdfb2f346d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:32.894386 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:32.895177 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:32.904269 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:32.905030 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:32.905486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:32.906369 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:32.906837 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:32.907350 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:33.333292 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b108738a-693e-47c7-9baa-d5bdfb2f346d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:33.343464 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b108738a-693e-47c7-9baa-d5bdfb2f346d tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.469074 Aug 29 19:08:33.343817 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:33.344056 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 75/147] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:32 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:33.349962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f16a3b75-dad1-4b41-b080-8765aa4caa8a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:33.350849 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f16a3b75-dad1-4b41-b080-8765aa4caa8a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:33.357697 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:33.359339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:33.360524 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f16a3b75-dad1-4b41-b080-8765aa4caa8a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:33.360667 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-31ddf354-722c-486d-a02a-6dbd1eba785b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.471965 Aug 29 19:08:33.361079 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f16a3b75-dad1-4b41-b080-8765aa4caa8a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:33.361542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 73/148] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:32 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:33.362121 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f16a3b75-dad1-4b41-b080-8765aa4caa8a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:33.362820 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f16a3b75-dad1-4b41-b080-8765aa4caa8a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:33.363327 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f16a3b75-dad1-4b41-b080-8765aa4caa8a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:33.363802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f16a3b75-dad1-4b41-b080-8765aa4caa8a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:33.384891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:33.500822 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f16a3b75-dad1-4b41-b080-8765aa4caa8a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:33.508927 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f16a3b75-dad1-4b41-b080-8765aa4caa8a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.163319 Aug 29 19:08:33.509494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 76/149] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:33 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:33.802597 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-970fb9c1-6941-45ce-9053-97816c980093 req-4de15554-ac6f-47a4-be5a-239dcdb43041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28b5c17-0afa-4fff-a814-653688b1231b", "name": "network-vif-plugged", "status": "completed", "tag": "ea5f3186-99cf-44d9-91d3-f823d8b73573"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:33.813173 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-970fb9c1-6941-45ce-9053-97816c980093 req-4de15554-ac6f-47a4-be5a-239dcdb43041 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:33.813753 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-970fb9c1-6941-45ce-9053-97816c980093 req-4de15554-ac6f-47a4-be5a-239dcdb43041 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:33.814266 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-970fb9c1-6941-45ce-9053-97816c980093 req-4de15554-ac6f-47a4-be5a-239dcdb43041 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:33.827185 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-970fb9c1-6941-45ce-9053-97816c980093 req-4de15554-ac6f-47a4-be5a-239dcdb43041 service nova] Creating event network-vif-plugged:ea5f3186-99cf-44d9-91d3-f823d8b73573 for instance b28b5c17-0afa-4fff-a814-653688b1231b on hv-cinder-73126 Aug 29 19:08:33.837177 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-970fb9c1-6941-45ce-9053-97816c980093 req-4de15554-ac6f-47a4-be5a-239dcdb43041 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118623 Aug 29 19:08:33.838354 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 74/150] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:33.880769 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a6f5b2c2-5715-4032-9d8d-fb217036bbae tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:33.881608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a6f5b2c2-5715-4032-9d8d-fb217036bbae tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:33.889278 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6f5b2c2-5715-4032-9d8d-fb217036bbae tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:33.889872 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6f5b2c2-5715-4032-9d8d-fb217036bbae tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:33.890419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6f5b2c2-5715-4032-9d8d-fb217036bbae tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:33.891257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6f5b2c2-5715-4032-9d8d-fb217036bbae tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:33.891882 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6f5b2c2-5715-4032-9d8d-fb217036bbae tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:33.892381 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6f5b2c2-5715-4032-9d8d-fb217036bbae tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:33.903238 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b861d1ca-e377-44f4-a0f6-74afe8c90e1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:33.905101 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b861d1ca-e377-44f4-a0f6-74afe8c90e1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:33.916240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b861d1ca-e377-44f4-a0f6-74afe8c90e1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:33.918652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b861d1ca-e377-44f4-a0f6-74afe8c90e1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:33.919728 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b861d1ca-e377-44f4-a0f6-74afe8c90e1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:33.920656 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b861d1ca-e377-44f4-a0f6-74afe8c90e1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:33.922093 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b861d1ca-e377-44f4-a0f6-74afe8c90e1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:33.923027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b861d1ca-e377-44f4-a0f6-74afe8c90e1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:34.165424 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b861d1ca-e377-44f4-a0f6-74afe8c90e1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:34.169189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a6f5b2c2-5715-4032-9d8d-fb217036bbae tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:34.170425 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:34.177148 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b861d1ca-e377-44f4-a0f6-74afe8c90e1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.279423 Aug 29 19:08:34.177754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a6f5b2c2-5715-4032-9d8d-fb217036bbae tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.301215 Aug 29 19:08:34.178742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 75/151] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:33 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:34.187559 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 77/152] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:33 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:34.365741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9af1fd4e-1e19-4776-81fd-6f561c1f5b85 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:34.366440 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9af1fd4e-1e19-4776-81fd-6f561c1f5b85 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:34.375095 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9af1fd4e-1e19-4776-81fd-6f561c1f5b85 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:34.375715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9af1fd4e-1e19-4776-81fd-6f561c1f5b85 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:34.376357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9af1fd4e-1e19-4776-81fd-6f561c1f5b85 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:34.377003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9af1fd4e-1e19-4776-81fd-6f561c1f5b85 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:34.377531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9af1fd4e-1e19-4776-81fd-6f561c1f5b85 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:34.378016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9af1fd4e-1e19-4776-81fd-6f561c1f5b85 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:34.386198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:34.387282 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:34.393602 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:34.394317 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:34.395098 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:34.395950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:34.396829 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:34.397282 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:34.596999 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9af1fd4e-1e19-4776-81fd-6f561c1f5b85 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:34.604239 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:34.605880 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9af1fd4e-1e19-4776-81fd-6f561c1f5b85 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.244587 Aug 29 19:08:34.606466 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 76/153] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:34 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:34.611726 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-046c9bfa-ea7e-42a4-96ff-fe1c17ba651d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:34.612578 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-046c9bfa-ea7e-42a4-96ff-fe1c17ba651d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:34.613104 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:34.614599 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:34.616079 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b68367b7-4b43-4d29-ad10-d6febcafc8de tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.235563 Aug 29 19:08:34.616651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 78/154] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:34 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:34.620679 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-046c9bfa-ea7e-42a4-96ff-fe1c17ba651d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:34.621440 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-046c9bfa-ea7e-42a4-96ff-fe1c17ba651d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:34.622088 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-046c9bfa-ea7e-42a4-96ff-fe1c17ba651d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:34.623276 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-046c9bfa-ea7e-42a4-96ff-fe1c17ba651d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:34.623857 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-046c9bfa-ea7e-42a4-96ff-fe1c17ba651d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:34.624384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-046c9bfa-ea7e-42a4-96ff-fe1c17ba651d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:34.758942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-046c9bfa-ea7e-42a4-96ff-fe1c17ba651d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:34.767026 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-046c9bfa-ea7e-42a4-96ff-fe1c17ba651d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.159255 Aug 29 19:08:34.767740 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 77/155] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:34 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:35.204407 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1cbc879c-eced-46dd-a496-56af55c98ebe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:35.207748 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1cbc879c-eced-46dd-a496-56af55c98ebe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:35.214339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fc9f6221-ea07-4ec4-9dfa-988ce28f695b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:35.214955 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fc9f6221-ea07-4ec4-9dfa-988ce28f695b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:35.223025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1cbc879c-eced-46dd-a496-56af55c98ebe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.223811 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1cbc879c-eced-46dd-a496-56af55c98ebe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.225074 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1cbc879c-eced-46dd-a496-56af55c98ebe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:35.227483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1cbc879c-eced-46dd-a496-56af55c98ebe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.229480 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9f6221-ea07-4ec4-9dfa-988ce28f695b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.230651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1cbc879c-eced-46dd-a496-56af55c98ebe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.232855 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1cbc879c-eced-46dd-a496-56af55c98ebe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:35.236969 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9f6221-ea07-4ec4-9dfa-988ce28f695b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.239465 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9f6221-ea07-4ec4-9dfa-988ce28f695b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:35.245957 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9f6221-ea07-4ec4-9dfa-988ce28f695b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.246709 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9f6221-ea07-4ec4-9dfa-988ce28f695b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.248137 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9f6221-ea07-4ec4-9dfa-988ce28f695b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:35.750152 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1cbc879c-eced-46dd-a496-56af55c98ebe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:35.775884 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1cbc879c-eced-46dd-a496-56af55c98ebe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.575200 Aug 29 19:08:35.777740 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 79/156] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:35 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:35.793337 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-affe8aab-ba49-4a81-8dd4-41972ed5d2e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:35.797982 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-affe8aab-ba49-4a81-8dd4-41972ed5d2e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:35.821012 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fc9f6221-ea07-4ec4-9dfa-988ce28f695b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:35.824524 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-affe8aab-ba49-4a81-8dd4-41972ed5d2e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.825799 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-affe8aab-ba49-4a81-8dd4-41972ed5d2e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.828203 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-affe8aab-ba49-4a81-8dd4-41972ed5d2e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:35.830105 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-affe8aab-ba49-4a81-8dd4-41972ed5d2e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.834369 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fc9f6221-ea07-4ec4-9dfa-988ce28f695b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.625039 Aug 29 19:08:35.847305 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-affe8aab-ba49-4a81-8dd4-41972ed5d2e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.847748 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-affe8aab-ba49-4a81-8dd4-41972ed5d2e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:35.854073 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 78/157] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:35 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:35.861614 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:35.864459 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:35.881649 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.888644 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.891688 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:35.892626 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:35.896510 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:35.896964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:36.303643 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-affe8aab-ba49-4a81-8dd4-41972ed5d2e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:36.318817 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-affe8aab-ba49-4a81-8dd4-41972ed5d2e4 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.537584 Aug 29 19:08:36.321036 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 80/158] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:35 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:36.338233 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-763dca42-42f2-43d5-a51c-9aebaab0c2c5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:36.338956 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-763dca42-42f2-43d5-a51c-9aebaab0c2c5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:36.350104 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-763dca42-42f2-43d5-a51c-9aebaab0c2c5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:36.354966 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-763dca42-42f2-43d5-a51c-9aebaab0c2c5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:36.355451 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-763dca42-42f2-43d5-a51c-9aebaab0c2c5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:36.356196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-763dca42-42f2-43d5-a51c-9aebaab0c2c5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:36.356655 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-763dca42-42f2-43d5-a51c-9aebaab0c2c5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:36.357547 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-763dca42-42f2-43d5-a51c-9aebaab0c2c5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:36.395182 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:36.408843 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:36.412191 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:36.415398 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-311baf7e-6440-4915-a3c1-7a41ebef7a62 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.560125 Aug 29 19:08:36.416694 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 79/159] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:35 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:36.422383 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-046d3a19-0205-4db8-8a26-b4d62c56ddc7 req-b51b7f8c-a4c2-4859-bdd3-aa17291e9d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f5cf3f-d9c5-4279-a896-d6dd9c50266a", "name": "network-vif-plugged", "status": "completed", "tag": "284ef1b6-7701-4493-93a6-1161589f2769"}, {"server_uuid": "22f96567-e842-4352-9e40-e31d2f547937", "name": "network-vif-plugged", "status": "completed", "tag": "2d38d71d-cc1e-42fd-b291-eb339787cf57"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:36.443983 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-046d3a19-0205-4db8-8a26-b4d62c56ddc7 req-b51b7f8c-a4c2-4859-bdd3-aa17291e9d03 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:36.444795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-046d3a19-0205-4db8-8a26-b4d62c56ddc7 req-b51b7f8c-a4c2-4859-bdd3-aa17291e9d03 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:36.445309 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-046d3a19-0205-4db8-8a26-b4d62c56ddc7 req-b51b7f8c-a4c2-4859-bdd3-aa17291e9d03 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:36.464343 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-046d3a19-0205-4db8-8a26-b4d62c56ddc7 req-b51b7f8c-a4c2-4859-bdd3-aa17291e9d03 service nova] Creating event network-vif-plugged:284ef1b6-7701-4493-93a6-1161589f2769 for instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a on hv-cinder-73126 Aug 29 19:08:36.465240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-046d3a19-0205-4db8-8a26-b4d62c56ddc7 req-b51b7f8c-a4c2-4859-bdd3-aa17291e9d03 service nova] Creating event network-vif-plugged:2d38d71d-cc1e-42fd-b291-eb339787cf57 for instance 22f96567-e842-4352-9e40-e31d2f547937 on hv-cinder-73126 Aug 29 19:08:36.472769 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-046d3a19-0205-4db8-8a26-b4d62c56ddc7 req-b51b7f8c-a4c2-4859-bdd3-aa17291e9d03 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054469 Aug 29 19:08:36.473802 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 80/160] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:36.558891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-763dca42-42f2-43d5-a51c-9aebaab0c2c5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:36.567958 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-763dca42-42f2-43d5-a51c-9aebaab0c2c5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.245594 Aug 29 19:08:36.569338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 81/161] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:36 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:36.805749 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ecc9857a-8e96-4e1d-9a9d-cc2cb36643b3 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:36.806764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ecc9857a-8e96-4e1d-9a9d-cc2cb36643b3 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:36.826169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecc9857a-8e96-4e1d-9a9d-cc2cb36643b3 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:36.828781 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecc9857a-8e96-4e1d-9a9d-cc2cb36643b3 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:36.829796 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecc9857a-8e96-4e1d-9a9d-cc2cb36643b3 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:36.832986 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecc9857a-8e96-4e1d-9a9d-cc2cb36643b3 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:36.835832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecc9857a-8e96-4e1d-9a9d-cc2cb36643b3 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:36.836441 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecc9857a-8e96-4e1d-9a9d-cc2cb36643b3 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:36.864026 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9a57c765-a4ce-4c2a-87f8-e16e45a4db94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:36.865751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9a57c765-a4ce-4c2a-87f8-e16e45a4db94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:36.880405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a57c765-a4ce-4c2a-87f8-e16e45a4db94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:36.881653 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a57c765-a4ce-4c2a-87f8-e16e45a4db94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:36.882350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a57c765-a4ce-4c2a-87f8-e16e45a4db94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:36.883910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a57c765-a4ce-4c2a-87f8-e16e45a4db94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:36.885553 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a57c765-a4ce-4c2a-87f8-e16e45a4db94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:36.887008 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9a57c765-a4ce-4c2a-87f8-e16e45a4db94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:37.151028 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ecc9857a-8e96-4e1d-9a9d-cc2cb36643b3 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:37.169865 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ecc9857a-8e96-4e1d-9a9d-cc2cb36643b3 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.370203 Aug 29 19:08:37.185568 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 81/162] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:36 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:37.193146 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9a57c765-a4ce-4c2a-87f8-e16e45a4db94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:37.207717 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9a57c765-a4ce-4c2a-87f8-e16e45a4db94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.344292 Aug 29 19:08:37.223140 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 82/163] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:36 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:37.342456 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f584178b-f5c6-4b3a-89d3-36f6175db5b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:37.343677 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f584178b-f5c6-4b3a-89d3-36f6175db5b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:37.351826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f584178b-f5c6-4b3a-89d3-36f6175db5b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:37.352595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f584178b-f5c6-4b3a-89d3-36f6175db5b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:37.355039 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f584178b-f5c6-4b3a-89d3-36f6175db5b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:37.359852 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f584178b-f5c6-4b3a-89d3-36f6175db5b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:37.361891 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f584178b-f5c6-4b3a-89d3-36f6175db5b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:37.363793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f584178b-f5c6-4b3a-89d3-36f6175db5b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:37.442288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:37.442879 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:37.465633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:37.467417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:37.485961 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:37.490089 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:37.490617 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:37.494384 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:37.758359 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:37.782540 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f584178b-f5c6-4b3a-89d3-36f6175db5b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:37.810641 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f584178b-f5c6-4b3a-89d3-36f6175db5b0 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.473909 Aug 29 19:08:37.823522 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 82/164] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:37 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:37.828953 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1ecd0e0e-0904-4102-8964-affe6bcfaa9d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:37.829798 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1ecd0e0e-0904-4102-8964-affe6bcfaa9d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:37.845251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ecd0e0e-0904-4102-8964-affe6bcfaa9d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:37.846392 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ecd0e0e-0904-4102-8964-affe6bcfaa9d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:37.848165 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ecd0e0e-0904-4102-8964-affe6bcfaa9d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:37.848165 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ecd0e0e-0904-4102-8964-affe6bcfaa9d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:37.848611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ecd0e0e-0904-4102-8964-affe6bcfaa9d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:37.849186 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ecd0e0e-0904-4102-8964-affe6bcfaa9d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:37.909109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:37.923888 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:37.925556 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:37.930311 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c2a7794f-44e3-47cb-b80d-349527859ab9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.491632 Aug 29 19:08:37.934638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 83/165] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:37 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:08:38.074887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1ecd0e0e-0904-4102-8964-affe6bcfaa9d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:38.084871 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1ecd0e0e-0904-4102-8964-affe6bcfaa9d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.259691 Aug 29 19:08:38.086169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 83/166] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:37 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:38.192314 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2156d18f-9e5d-4d20-a245-f1a73eec2956 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:38.192925 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2156d18f-9e5d-4d20-a245-f1a73eec2956 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:38.200820 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2156d18f-9e5d-4d20-a245-f1a73eec2956 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.201793 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2156d18f-9e5d-4d20-a245-f1a73eec2956 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.201793 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2156d18f-9e5d-4d20-a245-f1a73eec2956 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:38.202735 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2156d18f-9e5d-4d20-a245-f1a73eec2956 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.203422 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2156d18f-9e5d-4d20-a245-f1a73eec2956 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.204011 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2156d18f-9e5d-4d20-a245-f1a73eec2956 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:38.245031 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ac3ddbc6-89da-46d4-8e80-dce49a0c7d19 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:38.245873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ac3ddbc6-89da-46d4-8e80-dce49a0c7d19 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:38.263704 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac3ddbc6-89da-46d4-8e80-dce49a0c7d19 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.264426 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac3ddbc6-89da-46d4-8e80-dce49a0c7d19 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.264916 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac3ddbc6-89da-46d4-8e80-dce49a0c7d19 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:38.265936 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac3ddbc6-89da-46d4-8e80-dce49a0c7d19 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.267738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac3ddbc6-89da-46d4-8e80-dce49a0c7d19 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.268392 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac3ddbc6-89da-46d4-8e80-dce49a0c7d19 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:38.541955 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2156d18f-9e5d-4d20-a245-f1a73eec2956 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:38.553981 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2156d18f-9e5d-4d20-a245-f1a73eec2956 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.365536 Aug 29 19:08:38.557424 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 84/167] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:38 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:38.586628 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ac3ddbc6-89da-46d4-8e80-dce49a0c7d19 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:38.594743 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ac3ddbc6-89da-46d4-8e80-dce49a0c7d19 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.356184 Aug 29 19:08:38.595620 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 84/168] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:38 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:38.833369 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-75c5197f-e1c1-4fee-aa7b-96844d046d38 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:38.834339 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-75c5197f-e1c1-4fee-aa7b-96844d046d38 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:38.842470 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75c5197f-e1c1-4fee-aa7b-96844d046d38 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.843105 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75c5197f-e1c1-4fee-aa7b-96844d046d38 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.843630 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75c5197f-e1c1-4fee-aa7b-96844d046d38 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:38.844457 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75c5197f-e1c1-4fee-aa7b-96844d046d38 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.844964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75c5197f-e1c1-4fee-aa7b-96844d046d38 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.845439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75c5197f-e1c1-4fee-aa7b-96844d046d38 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:38.961666 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:38.962697 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:38.972076 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.973111 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.974057 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:38.975304 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:38.975768 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:38.976435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:38.996682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-75c5197f-e1c1-4fee-aa7b-96844d046d38 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:39.004862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-75c5197f-e1c1-4fee-aa7b-96844d046d38 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.176021 Aug 29 19:08:39.005995 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 85/169] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:38 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:39.109790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a940fb57-e25a-4d77-ab71-5e5a1e8dc200 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:39.110968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a940fb57-e25a-4d77-ab71-5e5a1e8dc200 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:39.122836 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a940fb57-e25a-4d77-ab71-5e5a1e8dc200 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:39.123845 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a940fb57-e25a-4d77-ab71-5e5a1e8dc200 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:39.125261 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a940fb57-e25a-4d77-ab71-5e5a1e8dc200 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:39.126666 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a940fb57-e25a-4d77-ab71-5e5a1e8dc200 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:39.127417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a940fb57-e25a-4d77-ab71-5e5a1e8dc200 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:39.128797 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a940fb57-e25a-4d77-ab71-5e5a1e8dc200 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:39.330890 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:39.345612 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:39.347224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:39.349061 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-4ae45f75-ddf9-4431-b36b-f7010b6a45e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.396743 Aug 29 19:08:39.364968 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 85/170] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:38 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:39.441933 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a940fb57-e25a-4d77-ab71-5e5a1e8dc200 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:39.453104 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a940fb57-e25a-4d77-ab71-5e5a1e8dc200 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.350092 Aug 29 19:08:39.466146 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 86/171] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:39 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:39.504221 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-ee71ed2d-c223-4ddc-9280-af87cb47c19b req-0363c594-992b-4a8c-96b5-ab3507c543bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f54a0ab-56bd-45b7-9026-0c998c315879", "name": "network-vif-plugged", "status": "completed", "tag": "2fadd321-bdd6-4593-985e-4b08308c8b84"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:39.530320 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ee71ed2d-c223-4ddc-9280-af87cb47c19b req-0363c594-992b-4a8c-96b5-ab3507c543bc service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:39.532327 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ee71ed2d-c223-4ddc-9280-af87cb47c19b req-0363c594-992b-4a8c-96b5-ab3507c543bc service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:39.532840 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ee71ed2d-c223-4ddc-9280-af87cb47c19b req-0363c594-992b-4a8c-96b5-ab3507c543bc service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:39.553893 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-ee71ed2d-c223-4ddc-9280-af87cb47c19b req-0363c594-992b-4a8c-96b5-ab3507c543bc service nova] Creating event network-vif-plugged:2fadd321-bdd6-4593-985e-4b08308c8b84 for instance 3f54a0ab-56bd-45b7-9026-0c998c315879 on hv-cinder-73126 Aug 29 19:08:39.568652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-ee71ed2d-c223-4ddc-9280-af87cb47c19b req-0363c594-992b-4a8c-96b5-ab3507c543bc service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069660 Aug 29 19:08:39.570919 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 86/172] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:39.579287 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-79e77746-00b7-4573-be6b-99338b6262cb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:39.579831 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-79e77746-00b7-4573-be6b-99338b6262cb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:39.592179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-79e77746-00b7-4573-be6b-99338b6262cb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:39.592179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-79e77746-00b7-4573-be6b-99338b6262cb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:39.592179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-79e77746-00b7-4573-be6b-99338b6262cb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:39.592738 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-79e77746-00b7-4573-be6b-99338b6262cb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:39.593192 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-79e77746-00b7-4573-be6b-99338b6262cb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:39.593622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-79e77746-00b7-4573-be6b-99338b6262cb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:39.619611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e4257a1e-670c-437d-8caf-6cb3198e07da tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:39.621058 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e4257a1e-670c-437d-8caf-6cb3198e07da tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:39.640596 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4257a1e-670c-437d-8caf-6cb3198e07da tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:39.645124 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4257a1e-670c-437d-8caf-6cb3198e07da tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:39.645609 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4257a1e-670c-437d-8caf-6cb3198e07da tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:39.646345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4257a1e-670c-437d-8caf-6cb3198e07da tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:39.646811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4257a1e-670c-437d-8caf-6cb3198e07da tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:39.647274 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4257a1e-670c-437d-8caf-6cb3198e07da tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:39.888813 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e4257a1e-670c-437d-8caf-6cb3198e07da tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:39.892217 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-79e77746-00b7-4573-be6b-99338b6262cb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:39.898898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e4257a1e-670c-437d-8caf-6cb3198e07da tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.284205 Aug 29 19:08:39.899942 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-79e77746-00b7-4573-be6b-99338b6262cb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.325637 Aug 29 19:08:39.901454 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 87/173] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:39 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:39.902310 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 87/174] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:39 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:40.028117 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c48a7491-c1be-4ba6-bc2e-8626509426fd tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:40.028858 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c48a7491-c1be-4ba6-bc2e-8626509426fd tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:40.039491 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c48a7491-c1be-4ba6-bc2e-8626509426fd tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.040049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c48a7491-c1be-4ba6-bc2e-8626509426fd tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.040705 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c48a7491-c1be-4ba6-bc2e-8626509426fd tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.042005 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c48a7491-c1be-4ba6-bc2e-8626509426fd tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.042797 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c48a7491-c1be-4ba6-bc2e-8626509426fd tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.043487 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c48a7491-c1be-4ba6-bc2e-8626509426fd tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.199913 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c48a7491-c1be-4ba6-bc2e-8626509426fd tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:40.208771 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c48a7491-c1be-4ba6-bc2e-8626509426fd tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1314 microversion: 2.1 time: 0.184458 Aug 29 19:08:40.209558 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 88/175] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:40 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:40.376948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:40.377900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:40.385999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.386844 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.387431 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.388695 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.389165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.389776 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.476788 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a07409e2-bb62-42e2-a79b-4c48c37dabf2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:40.477023 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a07409e2-bb62-42e2-a79b-4c48c37dabf2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:40.489466 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07409e2-bb62-42e2-a79b-4c48c37dabf2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.493297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07409e2-bb62-42e2-a79b-4c48c37dabf2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.493855 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07409e2-bb62-42e2-a79b-4c48c37dabf2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.494606 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07409e2-bb62-42e2-a79b-4c48c37dabf2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.495102 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07409e2-bb62-42e2-a79b-4c48c37dabf2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.495562 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07409e2-bb62-42e2-a79b-4c48c37dabf2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.658752 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:40.672225 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:40.674263 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:40.676463 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-4cc45f22-64fa-43c0-9bae-cefe62c9a44c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.304648 Aug 29 19:08:40.677991 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 88/176] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:40 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:40.800695 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a07409e2-bb62-42e2-a79b-4c48c37dabf2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:40.815529 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a07409e2-bb62-42e2-a79b-4c48c37dabf2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1364 microversion: 2.1 time: 0.343119 Aug 29 19:08:40.816134 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 89/177] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:40 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1364 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:40.923394 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bb76ea1d-9a37-4fb9-93cf-6cea81a04397 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:40.924567 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bb76ea1d-9a37-4fb9-93cf-6cea81a04397 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:40.924783 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5b3018d6-8f4b-414f-841e-f5b2447007f8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:40.925574 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5b3018d6-8f4b-414f-841e-f5b2447007f8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:40.934606 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb76ea1d-9a37-4fb9-93cf-6cea81a04397 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.935405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb76ea1d-9a37-4fb9-93cf-6cea81a04397 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.936218 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb76ea1d-9a37-4fb9-93cf-6cea81a04397 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.937560 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb76ea1d-9a37-4fb9-93cf-6cea81a04397 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.938199 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b3018d6-8f4b-414f-841e-f5b2447007f8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.939129 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b3018d6-8f4b-414f-841e-f5b2447007f8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.939460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb76ea1d-9a37-4fb9-93cf-6cea81a04397 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.939578 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b3018d6-8f4b-414f-841e-f5b2447007f8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.940162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb76ea1d-9a37-4fb9-93cf-6cea81a04397 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:40.940284 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b3018d6-8f4b-414f-841e-f5b2447007f8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:40.940706 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b3018d6-8f4b-414f-841e-f5b2447007f8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:40.941713 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b3018d6-8f4b-414f-841e-f5b2447007f8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.275238 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5b3018d6-8f4b-414f-841e-f5b2447007f8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:41.288717 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5b3018d6-8f4b-414f-841e-f5b2447007f8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.368720 Aug 29 19:08:41.289379 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 90/178] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:40 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:41.307151 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-bbd358c8-d32b-4fab-be62-dfc02361dde5 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:41.313676 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-bbd358c8-d32b-4fab-be62-dfc02361dde5 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:41.321302 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bbd358c8-d32b-4fab-be62-dfc02361dde5 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.321834 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bbd358c8-d32b-4fab-be62-dfc02361dde5 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.322251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bbd358c8-d32b-4fab-be62-dfc02361dde5 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.339159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bbd358c8-d32b-4fab-be62-dfc02361dde5 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.339953 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bbd358c8-d32b-4fab-be62-dfc02361dde5 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.340500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bbd358c8-d32b-4fab-be62-dfc02361dde5 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.356098 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-bb76ea1d-9a37-4fb9-93cf-6cea81a04397 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:41.365273 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bb76ea1d-9a37-4fb9-93cf-6cea81a04397 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.448416 Aug 29 19:08:41.379375 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 89/179] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:40 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:41.558982 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-bbd358c8-d32b-4fab-be62-dfc02361dde5 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:41.568514 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-bbd358c8-d32b-4fab-be62-dfc02361dde5 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1501 microversion: 2.1 time: 0.265239 Aug 29 19:08:41.569097 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 91/180] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:41 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1501 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:41.641854 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-49d61ab8-bc15-41f1-b8d3-4765fab34d2b req-62be3c13-727b-4aac-a044-d11fd5b33d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4696f764-f3e7-482f-b94e-549896198ddf", "name": "network-vif-plugged", "status": "completed", "tag": "90bec49f-36b1-4027-8fc3-86cd4d15e3f4"}, {"server_uuid": "0792b7a2-491c-41dc-b356-6116396636b7", "name": "network-vif-plugged", "status": "completed", "tag": "2773a328-c32b-4251-884e-1d7401f1853a"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:41.664749 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-49d61ab8-bc15-41f1-b8d3-4765fab34d2b req-62be3c13-727b-4aac-a044-d11fd5b33d3a service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.667769 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-49d61ab8-bc15-41f1-b8d3-4765fab34d2b req-62be3c13-727b-4aac-a044-d11fd5b33d3a service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.668405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-49d61ab8-bc15-41f1-b8d3-4765fab34d2b req-62be3c13-727b-4aac-a044-d11fd5b33d3a service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.699568 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:41.700424 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:41.708975 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.709471 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.709903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.711464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.717117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-49d61ab8-bc15-41f1-b8d3-4765fab34d2b req-62be3c13-727b-4aac-a044-d11fd5b33d3a service nova] Creating event network-vif-plugged:90bec49f-36b1-4027-8fc3-86cd4d15e3f4 for instance 4696f764-f3e7-482f-b94e-549896198ddf on hv-cinder-73126 Aug 29 19:08:41.719365 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-49d61ab8-bc15-41f1-b8d3-4765fab34d2b req-62be3c13-727b-4aac-a044-d11fd5b33d3a service nova] Creating event network-vif-plugged:2773a328-c32b-4251-884e-1d7401f1853a for instance 0792b7a2-491c-41dc-b356-6116396636b7 on hv-cinder-73126 Aug 29 19:08:41.728536 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.729266 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.738625 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-49d61ab8-bc15-41f1-b8d3-4765fab34d2b req-62be3c13-727b-4aac-a044-d11fd5b33d3a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104608 Aug 29 19:08:41.744440 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 90/181] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:41.840149 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-eacd7497-8116-48e4-8ebc-f3861ee181f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:41.841428 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-eacd7497-8116-48e4-8ebc-f3861ee181f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:41.858772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eacd7497-8116-48e4-8ebc-f3861ee181f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.858772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eacd7497-8116-48e4-8ebc-f3861ee181f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.858772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eacd7497-8116-48e4-8ebc-f3861ee181f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:41.858772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eacd7497-8116-48e4-8ebc-f3861ee181f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:41.859469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eacd7497-8116-48e4-8ebc-f3861ee181f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:41.859469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eacd7497-8116-48e4-8ebc-f3861ee181f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:42.022191 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:42.042121 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:42.044083 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:42.048352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e8902491-bf6e-40d8-9d31-ee48437d666c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.352384 Aug 29 19:08:42.066389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 92/182] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:41 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:42.236236 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-eacd7497-8116-48e4-8ebc-f3861ee181f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:42.254044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-eacd7497-8116-48e4-8ebc-f3861ee181f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1550 microversion: 2.1 time: 0.421132 Aug 29 19:08:42.254795 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 91/183] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:41 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1550 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:42.281936 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8b4a6f39-8ac1-4f52-887d-e9cca95e4718 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:42.283247 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8b4a6f39-8ac1-4f52-887d-e9cca95e4718 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:42.291320 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b4a6f39-8ac1-4f52-887d-e9cca95e4718 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:42.292001 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b4a6f39-8ac1-4f52-887d-e9cca95e4718 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:42.292505 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b4a6f39-8ac1-4f52-887d-e9cca95e4718 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:42.293374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b4a6f39-8ac1-4f52-887d-e9cca95e4718 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:42.294010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b4a6f39-8ac1-4f52-887d-e9cca95e4718 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:42.294520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b4a6f39-8ac1-4f52-887d-e9cca95e4718 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:42.314321 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-53e99625-a312-4f17-beeb-b45e5e8ab8bf tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:42.315859 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-53e99625-a312-4f17-beeb-b45e5e8ab8bf tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:42.331657 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-53e99625-a312-4f17-beeb-b45e5e8ab8bf tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:42.333068 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-53e99625-a312-4f17-beeb-b45e5e8ab8bf tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:42.334369 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-53e99625-a312-4f17-beeb-b45e5e8ab8bf tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:42.335891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-53e99625-a312-4f17-beeb-b45e5e8ab8bf tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:42.336977 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-53e99625-a312-4f17-beeb-b45e5e8ab8bf tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:42.338257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-53e99625-a312-4f17-beeb-b45e5e8ab8bf tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:42.449538 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8b4a6f39-8ac1-4f52-887d-e9cca95e4718 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171682 Aug 29 19:08:42.450147 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 93/184] 10.222.0.94 () {58 vars in 1275 bytes} [Mon Aug 29 19:08:42 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:42.455404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-cb401142-0eba-4886-8238-214ae8151db5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:42.456020 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-cb401142-0eba-4886-8238-214ae8151db5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:42.472504 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb401142-0eba-4886-8238-214ae8151db5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:42.473112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb401142-0eba-4886-8238-214ae8151db5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:42.474538 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb401142-0eba-4886-8238-214ae8151db5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:42.475294 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb401142-0eba-4886-8238-214ae8151db5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:42.478520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb401142-0eba-4886-8238-214ae8151db5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:42.478991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb401142-0eba-4886-8238-214ae8151db5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:42.490146 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:43.129489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-53e99625-a312-4f17-beeb-b45e5e8ab8bf tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:43.141220 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-53e99625-a312-4f17-beeb-b45e5e8ab8bf tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1368 microversion: 2.1 time: 0.834148 Aug 29 19:08:43.141828 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 92/185] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:42 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1368 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:43.165788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:43.166437 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:43.174513 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-cb401142-0eba-4886-8238-214ae8151db5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:43.192128 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-cb401142-0eba-4886-8238-214ae8151db5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.740612 Aug 29 19:08:43.193266 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 94/186] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:42 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:43.196667 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:43.197316 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:43.200998 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:43.201790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:43.202267 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:43.202706 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:43.229729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e8ffe721-fb05-4217-8fe4-4ba4da06667b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8993d57b-d099-4208-9f21-7d4275eda364"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:43.242905 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e8ffe721-fb05-4217-8fe4-4ba4da06667b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:43.250328 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ffe721-fb05-4217-8fe4-4ba4da06667b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:43.251010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ffe721-fb05-4217-8fe4-4ba4da06667b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:43.251694 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ffe721-fb05-4217-8fe4-4ba4da06667b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:43.252554 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ffe721-fb05-4217-8fe4-4ba4da06667b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:43.253163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ffe721-fb05-4217-8fe4-4ba4da06667b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:43.253926 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ffe721-fb05-4217-8fe4-4ba4da06667b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:43.675831 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:43.679450 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:43.693140 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:43.695608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:43.696964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ec030bf7-b7fd-47e3-b045-7d7d20cf26e9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.553329 Aug 29 19:08:43.701264 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 93/187] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:43 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:44.163513 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d3ca74e1-bfb6-4840-bacb-ca60ef16ea1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:44.164305 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d3ca74e1-bfb6-4840-bacb-ca60ef16ea1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:44.171346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3ca74e1-bfb6-4840-bacb-ca60ef16ea1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:44.172461 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3ca74e1-bfb6-4840-bacb-ca60ef16ea1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:44.173077 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3ca74e1-bfb6-4840-bacb-ca60ef16ea1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:44.174034 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3ca74e1-bfb6-4840-bacb-ca60ef16ea1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:44.174665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3ca74e1-bfb6-4840-bacb-ca60ef16ea1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:44.175205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3ca74e1-bfb6-4840-bacb-ca60ef16ea1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:44.441058 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d3ca74e1-bfb6-4840-bacb-ca60ef16ea1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:44.449862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d3ca74e1-bfb6-4840-bacb-ca60ef16ea1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1559 microversion: 2.1 time: 0.290307 Aug 29 19:08:44.466350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 94/188] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:44 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1559 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:44.466350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c0c181fc-501a-4223-80ec-81018d1b0665 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:44.466350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c0c181fc-501a-4223-80ec-81018d1b0665 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:44.466350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0c181fc-501a-4223-80ec-81018d1b0665 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:44.466831 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0c181fc-501a-4223-80ec-81018d1b0665 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:44.467064 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0c181fc-501a-4223-80ec-81018d1b0665 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:44.467798 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0c181fc-501a-4223-80ec-81018d1b0665 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:44.468316 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0c181fc-501a-4223-80ec-81018d1b0665 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:44.468768 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0c181fc-501a-4223-80ec-81018d1b0665 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:44.689917 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c0c181fc-501a-4223-80ec-81018d1b0665 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:44.700271 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c0c181fc-501a-4223-80ec-81018d1b0665 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.248803 Aug 29 19:08:44.700855 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 95/189] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:44 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:44.718074 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-270597eb-7b5f-48b9-9dd0-67493ed2e402 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:44.719323 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-270597eb-7b5f-48b9-9dd0-67493ed2e402 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:44.727146 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-270597eb-7b5f-48b9-9dd0-67493ed2e402 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:44.727962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-270597eb-7b5f-48b9-9dd0-67493ed2e402 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:44.728571 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-270597eb-7b5f-48b9-9dd0-67493ed2e402 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:44.729444 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-270597eb-7b5f-48b9-9dd0-67493ed2e402 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:44.730070 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-270597eb-7b5f-48b9-9dd0-67493ed2e402 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:44.739323 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-270597eb-7b5f-48b9-9dd0-67493ed2e402 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:44.949226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-270597eb-7b5f-48b9-9dd0-67493ed2e402 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.241891 Aug 29 19:08:44.950107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 96/190] 10.222.0.94 () {58 vars in 1275 bytes} [Mon Aug 29 19:08:44 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-interface => generated 285 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:44.956146 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-0d5c3add-1b51-4204-aee3-162eca2aa6d2 req-73518a41-d898-4b1d-9491-2ade22d45130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22f96567-e842-4352-9e40-e31d2f547937", "tag": "2d38d71d-cc1e-42fd-b291-eb339787cf57"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:44.971466 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-0d5c3add-1b51-4204-aee3-162eca2aa6d2 req-73518a41-d898-4b1d-9491-2ade22d45130 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:44.972387 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-0d5c3add-1b51-4204-aee3-162eca2aa6d2 req-73518a41-d898-4b1d-9491-2ade22d45130 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:44.973014 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-0d5c3add-1b51-4204-aee3-162eca2aa6d2 req-73518a41-d898-4b1d-9491-2ade22d45130 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:44.998534 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-0d5c3add-1b51-4204-aee3-162eca2aa6d2 req-73518a41-d898-4b1d-9491-2ade22d45130 service nova] Creating event network-changed:2d38d71d-cc1e-42fd-b291-eb339787cf57 for instance 22f96567-e842-4352-9e40-e31d2f547937 on hv-cinder-73126 Aug 29 19:08:45.009698 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-0d5c3add-1b51-4204-aee3-162eca2aa6d2 req-73518a41-d898-4b1d-9491-2ade22d45130 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054263 Aug 29 19:08:45.011694 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 97/191] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:45.023952 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:45.024693 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:45.039631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:45.040155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:45.040589 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:45.043402 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:45.043946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:45.046306 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:45.342261 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:45.357170 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:45.359361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:45.360551 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-280a0323-cb22-486e-bf93-b5489dcdf6f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.347691 Aug 29 19:08:45.361163 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 98/192] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:45 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:45.726644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e1e4d564-a9b1-47df-a427-1d8e70145121 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:45.727560 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e1e4d564-a9b1-47df-a427-1d8e70145121 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:45.735856 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1e4d564-a9b1-47df-a427-1d8e70145121 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:45.736738 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1e4d564-a9b1-47df-a427-1d8e70145121 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:45.737642 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1e4d564-a9b1-47df-a427-1d8e70145121 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:45.739318 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1e4d564-a9b1-47df-a427-1d8e70145121 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:45.740005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1e4d564-a9b1-47df-a427-1d8e70145121 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:45.740653 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1e4d564-a9b1-47df-a427-1d8e70145121 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:45.989646 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e1e4d564-a9b1-47df-a427-1d8e70145121 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:45.997881 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e1e4d564-a9b1-47df-a427-1d8e70145121 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.280642 Aug 29 19:08:46.000979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 99/193] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:45 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:46.388962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:46.389655 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:46.397279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:46.398733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:46.399622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:46.400617 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:46.402272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:46.402709 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:46.577319 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:46.586890 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:46.588857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:46.589974 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-22dd7139-7c11-4273-970d-c93aea692959 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.205242 Aug 29 19:08:46.590543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 100/194] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:46 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:46.904187 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-d944e381-b62c-446b-986b-703f19d9e55b req-ac18f5ab-fcc0-458c-b998-e3ba726c9e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f54a0ab-56bd-45b7-9026-0c998c315879", "tag": "2fadd321-bdd6-4593-985e-4b08308c8b84"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:46.914852 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-d944e381-b62c-446b-986b-703f19d9e55b req-ac18f5ab-fcc0-458c-b998-e3ba726c9e47 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:46.915361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-d944e381-b62c-446b-986b-703f19d9e55b req-ac18f5ab-fcc0-458c-b998-e3ba726c9e47 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:46.916139 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-d944e381-b62c-446b-986b-703f19d9e55b req-ac18f5ab-fcc0-458c-b998-e3ba726c9e47 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:46.928372 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-d944e381-b62c-446b-986b-703f19d9e55b req-ac18f5ab-fcc0-458c-b998-e3ba726c9e47 service nova] Creating event network-changed:2fadd321-bdd6-4593-985e-4b08308c8b84 for instance 3f54a0ab-56bd-45b7-9026-0c998c315879 on hv-cinder-73126 Aug 29 19:08:46.935097 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-d944e381-b62c-446b-986b-703f19d9e55b req-ac18f5ab-fcc0-458c-b998-e3ba726c9e47 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035539 Aug 29 19:08:46.936263 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 101/195] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:47.021894 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-74cd9875-c1c8-4520-8ec3-32360923d178 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:47.023533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-74cd9875-c1c8-4520-8ec3-32360923d178 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:47.033380 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-74cd9875-c1c8-4520-8ec3-32360923d178 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:47.034068 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-74cd9875-c1c8-4520-8ec3-32360923d178 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:47.035804 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-74cd9875-c1c8-4520-8ec3-32360923d178 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:47.036865 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-74cd9875-c1c8-4520-8ec3-32360923d178 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:47.041178 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-74cd9875-c1c8-4520-8ec3-32360923d178 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:47.041809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-74cd9875-c1c8-4520-8ec3-32360923d178 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:47.190560 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-74cd9875-c1c8-4520-8ec3-32360923d178 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:47.199331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-74cd9875-c1c8-4520-8ec3-32360923d178 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.182054 Aug 29 19:08:47.200637 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 102/196] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:47 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:47.613109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:47.613717 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:47.620769 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:47.621481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:47.622109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:47.623001 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:47.623489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:47.623918 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:47.772724 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:47.784676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:47.786199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:47.787408 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3742314a-8e8a-4bd0-97e0-1b2bda0ec037 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.178022 Aug 29 19:08:47.788320 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 103/197] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:47 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:08:48.221246 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9ce9877f-b2a6-47fe-b9b1-1e44c9a09137 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:48.222048 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9ce9877f-b2a6-47fe-b9b1-1e44c9a09137 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:48.229246 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ce9877f-b2a6-47fe-b9b1-1e44c9a09137 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:48.229746 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ce9877f-b2a6-47fe-b9b1-1e44c9a09137 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:48.230184 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ce9877f-b2a6-47fe-b9b1-1e44c9a09137 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:48.230900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ce9877f-b2a6-47fe-b9b1-1e44c9a09137 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:48.231459 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ce9877f-b2a6-47fe-b9b1-1e44c9a09137 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:48.231884 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ce9877f-b2a6-47fe-b9b1-1e44c9a09137 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:48.388633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9ce9877f-b2a6-47fe-b9b1-1e44c9a09137 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:48.396840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9ce9877f-b2a6-47fe-b9b1-1e44c9a09137 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.179395 Aug 29 19:08:48.397472 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 104/198] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:48 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:48.811995 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:48.812660 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:48.819160 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:48.819643 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:48.820946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:48.821772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:48.822220 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:48.822640 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:48.968502 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:48.977534 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:48.979024 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:48.980164 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8521dbf5-6aaf-459f-94aa-31f1294013a1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.173067 Aug 29 19:08:48.980736 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 105/199] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:48 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:08:49.418083 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e9261c50-1277-4bbb-9301-e342b06812e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:49.418719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e9261c50-1277-4bbb-9301-e342b06812e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:49.426489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9261c50-1277-4bbb-9301-e342b06812e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:49.426982 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9261c50-1277-4bbb-9301-e342b06812e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:49.427451 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9261c50-1277-4bbb-9301-e342b06812e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:49.428255 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9261c50-1277-4bbb-9301-e342b06812e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:49.428594 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9261c50-1277-4bbb-9301-e342b06812e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:49.429029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9261c50-1277-4bbb-9301-e342b06812e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:49.568914 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e9261c50-1277-4bbb-9301-e342b06812e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:49.577316 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e9261c50-1277-4bbb-9301-e342b06812e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1321 microversion: 2.1 time: 0.163819 Aug 29 19:08:49.578105 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 106/200] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:49 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:50.009462 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:50.010072 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:50.017994 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:50.018485 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:50.018920 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:50.019633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:50.021502 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:50.024783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:50.296548 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:50.306808 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:50.312648 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:50.313978 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6d593e4f-5587-46b4-83e8-e72dd6488fc3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1406 microversion: 2.20 time: 0.309383 Aug 29 19:08:50.315438 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 107/201] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:50 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:50.403516 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e8ffe721-fb05-4217-8fe4-4ba4da06667b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "POST /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.182931 Aug 29 19:08:50.406514 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 95/202] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:08:43 2022] POST /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a/os-volume_attachments => generated 194 bytes in 7186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:08:50.597938 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2fc6f7ec-75bb-4afa-94a5-ffe63ec9d4ee tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:50.598993 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2fc6f7ec-75bb-4afa-94a5-ffe63ec9d4ee tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:50.605544 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2fc6f7ec-75bb-4afa-94a5-ffe63ec9d4ee tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:50.606005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2fc6f7ec-75bb-4afa-94a5-ffe63ec9d4ee tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:50.606439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2fc6f7ec-75bb-4afa-94a5-ffe63ec9d4ee tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:50.607229 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2fc6f7ec-75bb-4afa-94a5-ffe63ec9d4ee tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:50.607851 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2fc6f7ec-75bb-4afa-94a5-ffe63ec9d4ee tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:50.608443 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2fc6f7ec-75bb-4afa-94a5-ffe63ec9d4ee tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:50.796844 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2fc6f7ec-75bb-4afa-94a5-ffe63ec9d4ee tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:50.805259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2fc6f7ec-75bb-4afa-94a5-ffe63ec9d4ee tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1515 microversion: 2.1 time: 0.210543 Aug 29 19:08:50.805844 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 108/203] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:50 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1515 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:50.829273 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-847daae2-9b41-463e-9d3c-9d3f87f098f5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:50.832866 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-847daae2-9b41-463e-9d3c-9d3f87f098f5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:50.839644 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-847daae2-9b41-463e-9d3c-9d3f87f098f5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:50.840135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-847daae2-9b41-463e-9d3c-9d3f87f098f5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:50.840578 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-847daae2-9b41-463e-9d3c-9d3f87f098f5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:50.841406 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-847daae2-9b41-463e-9d3c-9d3f87f098f5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:50.841869 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-847daae2-9b41-463e-9d3c-9d3f87f098f5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:50.842297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-847daae2-9b41-463e-9d3c-9d3f87f098f5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:50.867399 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-847daae2-9b41-463e-9d3c-9d3f87f098f5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lazy-loading 'flavor' on Instance uuid 0792b7a2-491c-41dc-b356-6116396636b7 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:08:50.989089 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-847daae2-9b41-463e-9d3c-9d3f87f098f5 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "POST /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7/action" status: 200 len: 32 microversion: 2.1 time: 0.165480 Aug 29 19:08:50.994087 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 96/204] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:08:50 2022] POST /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:08:51.000285 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-36c89f55-09e0-4992-8f76-9bbce74cfb3b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:51.000982 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-36c89f55-09e0-4992-8f76-9bbce74cfb3b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:51.008378 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-36c89f55-09e0-4992-8f76-9bbce74cfb3b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:51.008988 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-36c89f55-09e0-4992-8f76-9bbce74cfb3b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:51.009497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-36c89f55-09e0-4992-8f76-9bbce74cfb3b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:51.010277 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-36c89f55-09e0-4992-8f76-9bbce74cfb3b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:51.010807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-36c89f55-09e0-4992-8f76-9bbce74cfb3b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:51.011332 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-36c89f55-09e0-4992-8f76-9bbce74cfb3b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:51.151727 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-36c89f55-09e0-4992-8f76-9bbce74cfb3b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:51.160153 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-36c89f55-09e0-4992-8f76-9bbce74cfb3b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.163866 Aug 29 19:08:51.160737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 109/205] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:50 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:51.339961 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:51.340661 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:51.347796 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:51.348280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:51.348719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:51.349413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:51.349897 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:51.350320 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:51.805906 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:51.819527 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:51.822912 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:51.827366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f535e3c6-2e14-4144-97b3-43e34b5a396c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1598 microversion: 2.20 time: 0.490031 Aug 29 19:08:51.829579 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 97/206] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:08:51 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1598 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:08:51.858246 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1f6ce479-bc4b-42bc-aaf3-48137102bbc2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:51.858872 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1f6ce479-bc4b-42bc-aaf3-48137102bbc2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:51.870729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f6ce479-bc4b-42bc-aaf3-48137102bbc2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:51.874033 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f6ce479-bc4b-42bc-aaf3-48137102bbc2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:51.874484 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f6ce479-bc4b-42bc-aaf3-48137102bbc2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:51.877910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f6ce479-bc4b-42bc-aaf3-48137102bbc2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:51.878713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f6ce479-bc4b-42bc-aaf3-48137102bbc2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:51.879283 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f6ce479-bc4b-42bc-aaf3-48137102bbc2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:52.182685 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c007e5fa-57cc-4b99-8f58-88c794d4a036 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:52.183546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c007e5fa-57cc-4b99-8f58-88c794d4a036 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:52.193168 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c007e5fa-57cc-4b99-8f58-88c794d4a036 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:52.195931 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c007e5fa-57cc-4b99-8f58-88c794d4a036 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:52.198656 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c007e5fa-57cc-4b99-8f58-88c794d4a036 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:52.199885 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c007e5fa-57cc-4b99-8f58-88c794d4a036 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:52.202300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c007e5fa-57cc-4b99-8f58-88c794d4a036 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:52.202956 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c007e5fa-57cc-4b99-8f58-88c794d4a036 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:52.321971 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1f6ce479-bc4b-42bc-aaf3-48137102bbc2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.469735 Aug 29 19:08:52.322603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 110/207] 10.222.0.94 () {60 vars in 1316 bytes} [Mon Aug 29 19:08:51 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-interface => generated 284 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:08:52.696424 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c007e5fa-57cc-4b99-8f58-88c794d4a036 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:52.705580 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c007e5fa-57cc-4b99-8f58-88c794d4a036 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.528186 Aug 29 19:08:52.706711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 98/208] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:52 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:53.730746 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a882411b-31de-4591-aa41-456b5615d18d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:53.730746 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a882411b-31de-4591-aa41-456b5615d18d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:53.737029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a882411b-31de-4591-aa41-456b5615d18d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:53.737739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a882411b-31de-4591-aa41-456b5615d18d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:53.738570 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a882411b-31de-4591-aa41-456b5615d18d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:53.739600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a882411b-31de-4591-aa41-456b5615d18d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:53.740210 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a882411b-31de-4591-aa41-456b5615d18d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:53.740833 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a882411b-31de-4591-aa41-456b5615d18d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:54.039910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a882411b-31de-4591-aa41-456b5615d18d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:54.048240 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a882411b-31de-4591-aa41-456b5615d18d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.325854 Aug 29 19:08:54.063888 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 111/209] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:53 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:54.385539 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-85c61eab-6667-4709-8505-4d403de74325 req-6e15f5c9-6413-456e-a7df-55e63b3f04e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4696f764-f3e7-482f-b94e-549896198ddf", "tag": "90bec49f-36b1-4027-8fc3-86cd4d15e3f4"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:08:54.406088 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-85c61eab-6667-4709-8505-4d403de74325 req-6e15f5c9-6413-456e-a7df-55e63b3f04e0 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:54.408353 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-85c61eab-6667-4709-8505-4d403de74325 req-6e15f5c9-6413-456e-a7df-55e63b3f04e0 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:54.408965 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-85c61eab-6667-4709-8505-4d403de74325 req-6e15f5c9-6413-456e-a7df-55e63b3f04e0 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:54.430223 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-85c61eab-6667-4709-8505-4d403de74325 req-6e15f5c9-6413-456e-a7df-55e63b3f04e0 service nova] Creating event network-changed:90bec49f-36b1-4027-8fc3-86cd4d15e3f4 for instance 4696f764-f3e7-482f-b94e-549896198ddf on hv-cinder-73126 Aug 29 19:08:54.436604 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-85c61eab-6667-4709-8505-4d403de74325 req-6e15f5c9-6413-456e-a7df-55e63b3f04e0 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054589 Aug 29 19:08:54.437864 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 99/210] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:08:55.071729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3851306e-b8b0-4fbd-9168-ccb3a6c90cfb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:55.073177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3851306e-b8b0-4fbd-9168-ccb3a6c90cfb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:55.084037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3851306e-b8b0-4fbd-9168-ccb3a6c90cfb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:55.088073 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3851306e-b8b0-4fbd-9168-ccb3a6c90cfb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:55.088762 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3851306e-b8b0-4fbd-9168-ccb3a6c90cfb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:55.089696 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3851306e-b8b0-4fbd-9168-ccb3a6c90cfb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:55.090787 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3851306e-b8b0-4fbd-9168-ccb3a6c90cfb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:55.091456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3851306e-b8b0-4fbd-9168-ccb3a6c90cfb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:55.111963 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:55.532490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3851306e-b8b0-4fbd-9168-ccb3a6c90cfb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:55.546328 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3851306e-b8b0-4fbd-9168-ccb3a6c90cfb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.479867 Aug 29 19:08:55.547403 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 112/211] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:55 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:08:56.571714 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-89d9b60d-4579-448a-8189-caa22bcb432f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:56.571714 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-89d9b60d-4579-448a-8189-caa22bcb432f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:56.577992 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89d9b60d-4579-448a-8189-caa22bcb432f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:56.578678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89d9b60d-4579-448a-8189-caa22bcb432f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:56.579309 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89d9b60d-4579-448a-8189-caa22bcb432f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:56.580422 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89d9b60d-4579-448a-8189-caa22bcb432f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:56.581175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89d9b60d-4579-448a-8189-caa22bcb432f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:56.581898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89d9b60d-4579-448a-8189-caa22bcb432f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:56.733873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-89d9b60d-4579-448a-8189-caa22bcb432f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:56.742338 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-89d9b60d-4579-448a-8189-caa22bcb432f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.177632 Aug 29 19:08:56.742886 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 100/212] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:56 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:57.762715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-990f780b-2f1e-4c7c-844d-26fdecd89c62 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:57.763840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-990f780b-2f1e-4c7c-844d-26fdecd89c62 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:57.772708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-990f780b-2f1e-4c7c-844d-26fdecd89c62 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:57.772891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-990f780b-2f1e-4c7c-844d-26fdecd89c62 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:57.773620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-990f780b-2f1e-4c7c-844d-26fdecd89c62 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:57.774471 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-990f780b-2f1e-4c7c-844d-26fdecd89c62 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:57.774938 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-990f780b-2f1e-4c7c-844d-26fdecd89c62 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:57.775401 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-990f780b-2f1e-4c7c-844d-26fdecd89c62 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:57.964911 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-990f780b-2f1e-4c7c-844d-26fdecd89c62 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:57.973816 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-990f780b-2f1e-4c7c-844d-26fdecd89c62 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.214898 Aug 29 19:08:57.974743 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 113/213] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:57 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:08:58.995976 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-897a3c9c-f162-425d-86bf-0c17f2e9a99f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:08:58.996701 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-897a3c9c-f162-425d-86bf-0c17f2e9a99f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:08:58.999050 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=71 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:08:59.004265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-897a3c9c-f162-425d-86bf-0c17f2e9a99f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:59.004748 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-897a3c9c-f162-425d-86bf-0c17f2e9a99f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:59.005178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-897a3c9c-f162-425d-86bf-0c17f2e9a99f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:59.005859 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-897a3c9c-f162-425d-86bf-0c17f2e9a99f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:08:59.006325 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-897a3c9c-f162-425d-86bf-0c17f2e9a99f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:08:59.006744 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-897a3c9c-f162-425d-86bf-0c17f2e9a99f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:08:59.140984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-897a3c9c-f162-425d-86bf-0c17f2e9a99f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:08:59.149503 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-897a3c9c-f162-425d-86bf-0c17f2e9a99f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.157491 Aug 29 19:08:59.150020 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 101/214] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:08:58 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:00.169913 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b8c2ae2a-0ec0-46f3-82a3-5d99aba989b1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:00.170524 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b8c2ae2a-0ec0-46f3-82a3-5d99aba989b1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:00.172457 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=91 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:00.178543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8c2ae2a-0ec0-46f3-82a3-5d99aba989b1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:00.178795 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8c2ae2a-0ec0-46f3-82a3-5d99aba989b1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:00.179467 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8c2ae2a-0ec0-46f3-82a3-5d99aba989b1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:00.180158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8c2ae2a-0ec0-46f3-82a3-5d99aba989b1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:00.180614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8c2ae2a-0ec0-46f3-82a3-5d99aba989b1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:00.181032 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8c2ae2a-0ec0-46f3-82a3-5d99aba989b1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:00.312404 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b8c2ae2a-0ec0-46f3-82a3-5d99aba989b1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:00.320874 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b8c2ae2a-0ec0-46f3-82a3-5d99aba989b1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.153898 Aug 29 19:09:00.321563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 114/215] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:00 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:01.342433 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ef7dfd0a-56f9-4d9f-8544-ed512291063d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:01.342950 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ef7dfd0a-56f9-4d9f-8544-ed512291063d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:01.349386 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef7dfd0a-56f9-4d9f-8544-ed512291063d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:01.349872 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef7dfd0a-56f9-4d9f-8544-ed512291063d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:01.350314 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef7dfd0a-56f9-4d9f-8544-ed512291063d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:01.351000 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef7dfd0a-56f9-4d9f-8544-ed512291063d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:01.352297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef7dfd0a-56f9-4d9f-8544-ed512291063d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:01.352643 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef7dfd0a-56f9-4d9f-8544-ed512291063d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:01.488316 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ef7dfd0a-56f9-4d9f-8544-ed512291063d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:01.496440 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ef7dfd0a-56f9-4d9f-8544-ed512291063d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.158089 Aug 29 19:09:01.497005 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 102/216] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:01 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:02.518540 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-776e04e8-e194-4bf3-979e-3a1a94224602 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:02.519171 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-776e04e8-e194-4bf3-979e-3a1a94224602 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:02.525857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-776e04e8-e194-4bf3-979e-3a1a94224602 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:02.526337 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-776e04e8-e194-4bf3-979e-3a1a94224602 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:02.526774 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-776e04e8-e194-4bf3-979e-3a1a94224602 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:02.527481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-776e04e8-e194-4bf3-979e-3a1a94224602 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:02.527937 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-776e04e8-e194-4bf3-979e-3a1a94224602 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:02.528361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-776e04e8-e194-4bf3-979e-3a1a94224602 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:02.659281 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-776e04e8-e194-4bf3-979e-3a1a94224602 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:02.668790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-776e04e8-e194-4bf3-979e-3a1a94224602 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.154055 Aug 29 19:09:02.669399 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 115/217] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:02 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:03.692655 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-39798dfe-01e4-41ef-a178-6071dfc21b97 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:03.693175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-39798dfe-01e4-41ef-a178-6071dfc21b97 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:03.700187 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39798dfe-01e4-41ef-a178-6071dfc21b97 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:03.700667 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39798dfe-01e4-41ef-a178-6071dfc21b97 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:03.701099 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39798dfe-01e4-41ef-a178-6071dfc21b97 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:03.701787 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39798dfe-01e4-41ef-a178-6071dfc21b97 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:03.702238 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39798dfe-01e4-41ef-a178-6071dfc21b97 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:03.702661 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39798dfe-01e4-41ef-a178-6071dfc21b97 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:03.831714 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-39798dfe-01e4-41ef-a178-6071dfc21b97 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:03.840915 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-39798dfe-01e4-41ef-a178-6071dfc21b97 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.152167 Aug 29 19:09:03.841793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 103/218] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:03 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:04.861976 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5d5c1cea-5941-49a7-b72d-88e4ae559cd3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:04.862588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5d5c1cea-5941-49a7-b72d-88e4ae559cd3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:04.869368 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5d5c1cea-5941-49a7-b72d-88e4ae559cd3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:04.869848 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5d5c1cea-5941-49a7-b72d-88e4ae559cd3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:04.870281 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5d5c1cea-5941-49a7-b72d-88e4ae559cd3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:04.870968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5d5c1cea-5941-49a7-b72d-88e4ae559cd3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:04.871473 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5d5c1cea-5941-49a7-b72d-88e4ae559cd3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:04.871899 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5d5c1cea-5941-49a7-b72d-88e4ae559cd3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:05.005912 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5d5c1cea-5941-49a7-b72d-88e4ae559cd3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:05.014317 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5d5c1cea-5941-49a7-b72d-88e4ae559cd3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.156483 Aug 29 19:09:05.014890 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 116/219] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:04 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:06.036740 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c5974a62-01f5-47fa-9469-8ac218798e4f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:06.037354 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c5974a62-01f5-47fa-9469-8ac218798e4f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:06.045542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5974a62-01f5-47fa-9469-8ac218798e4f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:06.046057 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5974a62-01f5-47fa-9469-8ac218798e4f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:06.046508 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5974a62-01f5-47fa-9469-8ac218798e4f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:06.047250 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5974a62-01f5-47fa-9469-8ac218798e4f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:06.047831 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5974a62-01f5-47fa-9469-8ac218798e4f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:06.048418 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5974a62-01f5-47fa-9469-8ac218798e4f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:06.188111 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c5974a62-01f5-47fa-9469-8ac218798e4f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:06.196130 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c5974a62-01f5-47fa-9469-8ac218798e4f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.163581 Aug 29 19:09:06.196703 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 104/220] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:06 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:06.626136 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-75fe6621-229c-4f14-b7d6-600ef563a491 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:06.626764 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-75fe6621-229c-4f14-b7d6-600ef563a491 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:06.634463 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75fe6621-229c-4f14-b7d6-600ef563a491 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:06.635227 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75fe6621-229c-4f14-b7d6-600ef563a491 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:06.635867 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75fe6621-229c-4f14-b7d6-600ef563a491 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:06.636807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75fe6621-229c-4f14-b7d6-600ef563a491 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:06.637388 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75fe6621-229c-4f14-b7d6-600ef563a491 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:06.638232 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75fe6621-229c-4f14-b7d6-600ef563a491 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:06.667806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-75fe6621-229c-4f14-b7d6-600ef563a491 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:09:06.780179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-75fe6621-229c-4f14-b7d6-600ef563a491 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "DELETE /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 204 len: 0 microversion: 2.1 time: 0.157254 Aug 29 19:09:06.784443 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 117/221] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:09:06 2022] DELETE /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:09:06.789561 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-adc9f226-896f-469b-a211-4e983d31f888 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:06.790415 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-adc9f226-896f-469b-a211-4e983d31f888 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:06.798546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-adc9f226-896f-469b-a211-4e983d31f888 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:06.799434 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-adc9f226-896f-469b-a211-4e983d31f888 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:06.800028 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-adc9f226-896f-469b-a211-4e983d31f888 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:06.800898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-adc9f226-896f-469b-a211-4e983d31f888 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:06.801575 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-adc9f226-896f-469b-a211-4e983d31f888 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:06.802171 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-adc9f226-896f-469b-a211-4e983d31f888 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:06.969443 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-adc9f226-896f-469b-a211-4e983d31f888 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:06.978777 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-adc9f226-896f-469b-a211-4e983d31f888 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1553 microversion: 2.1 time: 0.193004 Aug 29 19:09:06.979403 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 105/222] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:06 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:07.217909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-97d95eb5-fcd9-4a9c-9f29-cc39437ff656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:07.218505 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-97d95eb5-fcd9-4a9c-9f29-cc39437ff656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:07.224448 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97d95eb5-fcd9-4a9c-9f29-cc39437ff656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:07.224932 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97d95eb5-fcd9-4a9c-9f29-cc39437ff656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:07.225364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97d95eb5-fcd9-4a9c-9f29-cc39437ff656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:07.226043 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97d95eb5-fcd9-4a9c-9f29-cc39437ff656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:07.226498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97d95eb5-fcd9-4a9c-9f29-cc39437ff656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:07.227091 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97d95eb5-fcd9-4a9c-9f29-cc39437ff656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:07.361959 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-97d95eb5-fcd9-4a9c-9f29-cc39437ff656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:07.370157 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-97d95eb5-fcd9-4a9c-9f29-cc39437ff656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.156475 Aug 29 19:09:07.370731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 118/223] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:07 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:07.999374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5bba69ab-486c-400f-80d8-76d0b4883a0c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:08.000572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5bba69ab-486c-400f-80d8-76d0b4883a0c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:08.007173 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bba69ab-486c-400f-80d8-76d0b4883a0c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:08.008142 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bba69ab-486c-400f-80d8-76d0b4883a0c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:08.008728 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bba69ab-486c-400f-80d8-76d0b4883a0c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:08.009476 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bba69ab-486c-400f-80d8-76d0b4883a0c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:08.009938 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bba69ab-486c-400f-80d8-76d0b4883a0c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:08.010364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bba69ab-486c-400f-80d8-76d0b4883a0c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:08.154463 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5bba69ab-486c-400f-80d8-76d0b4883a0c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:08.164297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5bba69ab-486c-400f-80d8-76d0b4883a0c tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1553 microversion: 2.1 time: 0.168229 Aug 29 19:09:08.165497 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 106/224] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:07 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:08.392029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a556d1a2-2007-400e-8223-489401048d4c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:08.392635 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a556d1a2-2007-400e-8223-489401048d4c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:08.400541 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a556d1a2-2007-400e-8223-489401048d4c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:08.401680 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a556d1a2-2007-400e-8223-489401048d4c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:08.402325 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a556d1a2-2007-400e-8223-489401048d4c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:08.403253 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a556d1a2-2007-400e-8223-489401048d4c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:08.403885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a556d1a2-2007-400e-8223-489401048d4c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:08.404870 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a556d1a2-2007-400e-8223-489401048d4c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:08.553082 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a556d1a2-2007-400e-8223-489401048d4c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:08.571344 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a556d1a2-2007-400e-8223-489401048d4c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.182832 Aug 29 19:09:08.572635 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 119/225] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:08 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:09.185684 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a69e0720-7467-4324-9f90-cb88f0972540 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:09.186324 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a69e0720-7467-4324-9f90-cb88f0972540 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:09.193180 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a69e0720-7467-4324-9f90-cb88f0972540 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:09.193693 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a69e0720-7467-4324-9f90-cb88f0972540 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:09.194138 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a69e0720-7467-4324-9f90-cb88f0972540 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:09.194864 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a69e0720-7467-4324-9f90-cb88f0972540 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:09.196013 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a69e0720-7467-4324-9f90-cb88f0972540 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:09.196699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a69e0720-7467-4324-9f90-cb88f0972540 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:09.334609 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a69e0720-7467-4324-9f90-cb88f0972540 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:09.343590 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a69e0720-7467-4324-9f90-cb88f0972540 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1553 microversion: 2.1 time: 0.161719 Aug 29 19:09:09.344214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 107/226] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:09 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:09.592736 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e8abfc9e-7897-4294-9365-1d049616fea7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:09.593216 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e8abfc9e-7897-4294-9365-1d049616fea7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:09.599169 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e8abfc9e-7897-4294-9365-1d049616fea7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:09.599652 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e8abfc9e-7897-4294-9365-1d049616fea7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:09.600080 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e8abfc9e-7897-4294-9365-1d049616fea7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:09.600760 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e8abfc9e-7897-4294-9365-1d049616fea7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:09.601206 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e8abfc9e-7897-4294-9365-1d049616fea7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:09.602981 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e8abfc9e-7897-4294-9365-1d049616fea7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:09.747247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e8abfc9e-7897-4294-9365-1d049616fea7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:09.756204 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e8abfc9e-7897-4294-9365-1d049616fea7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.167262 Aug 29 19:09:09.756988 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 120/227] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:09 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:10.365307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b7d9638f-3745-44ed-b80e-4dadacac6e12 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:10.365960 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b7d9638f-3745-44ed-b80e-4dadacac6e12 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:10.373183 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b7d9638f-3745-44ed-b80e-4dadacac6e12 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:10.373728 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b7d9638f-3745-44ed-b80e-4dadacac6e12 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:10.374366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b7d9638f-3745-44ed-b80e-4dadacac6e12 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:10.375143 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b7d9638f-3745-44ed-b80e-4dadacac6e12 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:10.375569 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b7d9638f-3745-44ed-b80e-4dadacac6e12 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:10.376005 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b7d9638f-3745-44ed-b80e-4dadacac6e12 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:10.380168 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:10.781883 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-02847cf9-1019-4ed8-8f8e-a78cc1abdc73 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:10.782514 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-02847cf9-1019-4ed8-8f8e-a78cc1abdc73 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:10.788828 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-02847cf9-1019-4ed8-8f8e-a78cc1abdc73 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:10.789613 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-02847cf9-1019-4ed8-8f8e-a78cc1abdc73 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:10.790311 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-02847cf9-1019-4ed8-8f8e-a78cc1abdc73 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:10.791228 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-02847cf9-1019-4ed8-8f8e-a78cc1abdc73 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:10.791680 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-02847cf9-1019-4ed8-8f8e-a78cc1abdc73 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:10.792248 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-02847cf9-1019-4ed8-8f8e-a78cc1abdc73 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:10.977623 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b7d9638f-3745-44ed-b80e-4dadacac6e12 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:10.987703 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b7d9638f-3745-44ed-b80e-4dadacac6e12 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1553 microversion: 2.1 time: 0.625906 Aug 29 19:09:10.988616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 108/228] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:10 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1553 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:11.130116 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-02847cf9-1019-4ed8-8f8e-a78cc1abdc73 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:11.139867 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-02847cf9-1019-4ed8-8f8e-a78cc1abdc73 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.361902 Aug 29 19:09:11.140709 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 121/229] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:10 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:11.343505 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-652539a1-18a7-424e-a4d7-1bf029591dc7 req-ed1c21a0-6f9f-4731-82f3-48ef8ce23f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f5cf3f-d9c5-4279-a896-d6dd9c50266a", "name": "network-vif-deleted", "tag": "284ef1b6-7701-4493-93a6-1161589f2769"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:11.358358 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-652539a1-18a7-424e-a4d7-1bf029591dc7 req-ed1c21a0-6f9f-4731-82f3-48ef8ce23f1e service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:11.359626 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-652539a1-18a7-424e-a4d7-1bf029591dc7 req-ed1c21a0-6f9f-4731-82f3-48ef8ce23f1e service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:11.360260 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-652539a1-18a7-424e-a4d7-1bf029591dc7 req-ed1c21a0-6f9f-4731-82f3-48ef8ce23f1e service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:11.376415 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-652539a1-18a7-424e-a4d7-1bf029591dc7 req-ed1c21a0-6f9f-4731-82f3-48ef8ce23f1e service nova] Creating event network-vif-deleted:284ef1b6-7701-4493-93a6-1161589f2769 for instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a on hv-cinder-73126 Aug 29 19:09:11.383954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-652539a1-18a7-424e-a4d7-1bf029591dc7 req-ed1c21a0-6f9f-4731-82f3-48ef8ce23f1e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044924 Aug 29 19:09:11.384574 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 109/230] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:12.009166 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7e55b9b8-27f4-4435-a630-267baee9f123 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:12.009790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7e55b9b8-27f4-4435-a630-267baee9f123 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:12.019376 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e55b9b8-27f4-4435-a630-267baee9f123 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:12.020038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e55b9b8-27f4-4435-a630-267baee9f123 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:12.020772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e55b9b8-27f4-4435-a630-267baee9f123 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:12.021818 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e55b9b8-27f4-4435-a630-267baee9f123 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:12.022276 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e55b9b8-27f4-4435-a630-267baee9f123 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:12.022701 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e55b9b8-27f4-4435-a630-267baee9f123 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:12.111429 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7e55b9b8-27f4-4435-a630-267baee9f123 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:12.121755 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7e55b9b8-27f4-4435-a630-267baee9f123 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1511 microversion: 2.1 time: 0.116930 Aug 29 19:09:12.122999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 122/231] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:12 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1511 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:12.163307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-df53b4d8-65bb-4353-9c3c-e1adb2bcf619 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:12.164915 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-df53b4d8-65bb-4353-9c3c-e1adb2bcf619 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:12.171445 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df53b4d8-65bb-4353-9c3c-e1adb2bcf619 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:12.172109 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df53b4d8-65bb-4353-9c3c-e1adb2bcf619 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:12.172723 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df53b4d8-65bb-4353-9c3c-e1adb2bcf619 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:12.173569 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df53b4d8-65bb-4353-9c3c-e1adb2bcf619 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:12.174164 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df53b4d8-65bb-4353-9c3c-e1adb2bcf619 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:12.174732 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df53b4d8-65bb-4353-9c3c-e1adb2bcf619 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:12.347271 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-df53b4d8-65bb-4353-9c3c-e1adb2bcf619 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:12.356108 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-df53b4d8-65bb-4353-9c3c-e1adb2bcf619 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.197674 Aug 29 19:09:12.356616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 110/232] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:12 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:13.145550 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e17ac427-4716-412d-b16a-e1266ea97c81 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:13.146753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e17ac427-4716-412d-b16a-e1266ea97c81 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:13.153744 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e17ac427-4716-412d-b16a-e1266ea97c81 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:13.154417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e17ac427-4716-412d-b16a-e1266ea97c81 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:13.155006 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e17ac427-4716-412d-b16a-e1266ea97c81 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:13.156706 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e17ac427-4716-412d-b16a-e1266ea97c81 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:13.157578 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e17ac427-4716-412d-b16a-e1266ea97c81 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:13.158209 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e17ac427-4716-412d-b16a-e1266ea97c81 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:13.276870 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e17ac427-4716-412d-b16a-e1266ea97c81 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:13.291751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e17ac427-4716-412d-b16a-e1266ea97c81 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1345 microversion: 2.1 time: 0.151030 Aug 29 19:09:13.292340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 123/233] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:13 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1345 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:13.378154 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-31f777ff-85c9-4e80-90ac-7acc5e5a309e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:13.379702 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-31f777ff-85c9-4e80-90ac-7acc5e5a309e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:13.387422 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31f777ff-85c9-4e80-90ac-7acc5e5a309e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:13.388859 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31f777ff-85c9-4e80-90ac-7acc5e5a309e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:13.389301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31f777ff-85c9-4e80-90ac-7acc5e5a309e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:13.390002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31f777ff-85c9-4e80-90ac-7acc5e5a309e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:13.390631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31f777ff-85c9-4e80-90ac-7acc5e5a309e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:13.391064 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-31f777ff-85c9-4e80-90ac-7acc5e5a309e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:13.558624 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-31f777ff-85c9-4e80-90ac-7acc5e5a309e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:13.573885 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-31f777ff-85c9-4e80-90ac-7acc5e5a309e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.199519 Aug 29 19:09:13.588600 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 111/234] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:13 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:14.312736 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:14.314015 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:14.319996 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:14.321091 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:14.321529 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:14.322260 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:14.322700 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:14.323150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:14.357034 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:14.357446 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:14.357972 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:14.358804 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lazy-loading 'fault' on Instance uuid 79f5cf3f-d9c5-4279-a896-d6dd9c50266a {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:09:14.410584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc580d348f154c4488a5f84640539655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f3f1161ef84f30bbd787e9361a0dac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:14.422034 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5814b399-3905-4abe-bb2c-8fe25a7ecefc tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 200 len: 1350 microversion: 2.1 time: 0.113044 Aug 29 19:09:14.422620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 124/235] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:14 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 1350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:14.594933 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-71a916d2-63dc-45f2-b68f-41ec651010e6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:14.595544 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-71a916d2-63dc-45f2-b68f-41ec651010e6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:14.602705 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-71a916d2-63dc-45f2-b68f-41ec651010e6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:14.603494 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-71a916d2-63dc-45f2-b68f-41ec651010e6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:14.604253 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-71a916d2-63dc-45f2-b68f-41ec651010e6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:14.604974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-71a916d2-63dc-45f2-b68f-41ec651010e6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:14.605436 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-71a916d2-63dc-45f2-b68f-41ec651010e6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:14.605873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-71a916d2-63dc-45f2-b68f-41ec651010e6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:14.754930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-71a916d2-63dc-45f2-b68f-41ec651010e6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:14.765343 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-71a916d2-63dc-45f2-b68f-41ec651010e6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.174232 Aug 29 19:09:14.766379 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 112/236] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:14 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:15.175919 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-901284851", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:15.228935 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] validate_networks() for None {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:09:15.443572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:15.444124 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:15.450880 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:15.451401 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:15.451840 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:15.452535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:15.452987 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:15.453416 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:15.468308 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] HTTP exception thrown: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Request method failure captured: Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a HTTP/1.1 Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6J_hCJAl2H-NIYlCVz1Gvx5UiROgxTRL0ZtULUL384TmlOwwe4393kTRXtPihroKh1IRLd0Y14YIrVrhPN6lED0uQ4-pW1Nt3tMsCZ2KTPVQGtupdoikeBBmO-LrhtKnvHvGS944ue8ewqB9q-bVFgTnBPPsIkOhr4keDCBEGG-C4 Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 74f3f1161ef84f30bbd787e9361a0dac Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:09:15.473306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/74f3f1161ef84f30bbd787e9361a0dac"}]}] Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 74f3f1161ef84f30bbd787e9361a0dac Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-DeleteServersTestJSON-1723207272-project Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: cc580d348f154c4488a5f84640539655 Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-DeleteServersTestJSON-1723207272-project Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:15.475016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '79f5cf3f-d9c5-4279-a896-d6dd9c50266a'} Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:09:15.475887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:15.478175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:15.479354 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Returning 404 to user: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:09:15.479354 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c53b919b-0569-4b88-9694-3b9deebfb59b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 404 len: 111 microversion: 2.1 time: 0.035142 Aug 29 19:09:15.479354 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 113/237] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:15 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:09:15.503289 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:09:15.503761 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:09:15.504312 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:09:15.504798 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:09:15.505321 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:09:15.515194 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:15.515710 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:15.516146 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:15.516992 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:15.517545 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:15.518078 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:15.540093 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Getting quotas for project 0f594096296743c583bf3f8e0c1f5110. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:09:15.546404 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Getting quotas for user 4c27047dbc2c40de89017865e41a0dc6 and project 0f594096296743c583bf3f8e0c1f5110. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:09:15.561090 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:09:15.563421 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:09:15.607597 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:15.610413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:15.617775 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:15.618268 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:15.618706 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:15.619427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:15.619882 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:15.620493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:15.626656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f8d7f0f7-f7f6-4c9a-a70a-1bbfea6db9c2 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.453600 Aug 29 19:09:15.627782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 125/238] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:09:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 456 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:09:15.639037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-122965da-0ee3-4e15-aa0d-4e66e022ea01 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:15.639772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-122965da-0ee3-4e15-aa0d-4e66e022ea01 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:15.642559 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] HTTP exception thrown: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Request method failure captured: Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a/os-volume_attachments HTTP/1.1 Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6J_hCJAl2H-NIYlCVz1Gvx5UiROgxTRL0ZtULUL384TmlOwwe4393kTRXtPihroKh1IRLd0Y14YIrVrhPN6lED0uQ4-pW1Nt3tMsCZ2KTPVQGtupdoikeBBmO-LrhtKnvHvGS944ue8ewqB9q-bVFgTnBPPsIkOhr4keDCBEGG-C4 Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 74f3f1161ef84f30bbd787e9361a0dac Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:09:15.645364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/74f3f1161ef84f30bbd787e9361a0dac"}]}] Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 74f3f1161ef84f30bbd787e9361a0dac Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-DeleteServersTestJSON-1723207272-project Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: cc580d348f154c4488a5f84640539655 Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-DeleteServersTestJSON-1723207272-project Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:15.646764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'server_id': '79f5cf3f-d9c5-4279-a896-d6dd9c50266a'} Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:09:15.647795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:15.650033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:15.653064 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Returning 404 to user: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:09:15.654857 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-34b130c5-b82c-4896-aa6f-82b17498cf0b tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.053817 Aug 29 19:09:15.659856 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 114/239] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:09:15 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a/os-volume_attachments => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:09:15.704601 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-122965da-0ee3-4e15-aa0d-4e66e022ea01 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:15.714706 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-122965da-0ee3-4e15-aa0d-4e66e022ea01 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1214 microversion: 2.1 time: 0.080041 Aug 29 19:09:15.715764 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 126/240] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:15 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1214 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:15.788186 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-589a11cd-91cb-4089-bf59-03312a6d815a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:15.789443 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-589a11cd-91cb-4089-bf59-03312a6d815a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:15.795568 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589a11cd-91cb-4089-bf59-03312a6d815a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:15.796366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589a11cd-91cb-4089-bf59-03312a6d815a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:15.796980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589a11cd-91cb-4089-bf59-03312a6d815a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:15.797855 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589a11cd-91cb-4089-bf59-03312a6d815a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:15.798407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589a11cd-91cb-4089-bf59-03312a6d815a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:15.798888 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-589a11cd-91cb-4089-bf59-03312a6d815a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:15.953439 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-589a11cd-91cb-4089-bf59-03312a6d815a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:15.961588 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-589a11cd-91cb-4089-bf59-03312a6d815a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.177452 Aug 29 19:09:15.962157 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 115/241] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:15 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:16.737014 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-208e6686-6f14-4f6e-8ccc-05df8c38d23d tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:16.737530 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-208e6686-6f14-4f6e-8ccc-05df8c38d23d tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:16.743841 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-208e6686-6f14-4f6e-8ccc-05df8c38d23d tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:16.744334 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-208e6686-6f14-4f6e-8ccc-05df8c38d23d tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:16.744792 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-208e6686-6f14-4f6e-8ccc-05df8c38d23d tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:16.745525 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-208e6686-6f14-4f6e-8ccc-05df8c38d23d tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:16.745989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-208e6686-6f14-4f6e-8ccc-05df8c38d23d tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:16.746417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-208e6686-6f14-4f6e-8ccc-05df8c38d23d tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:16.810348 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-208e6686-6f14-4f6e-8ccc-05df8c38d23d tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:16.818376 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-208e6686-6f14-4f6e-8ccc-05df8c38d23d tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1266 microversion: 2.1 time: 0.085276 Aug 29 19:09:16.819230 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 127/242] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:16 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:16.916751 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:16.917472 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:16.923924 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:16.924405 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:16.924835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:16.925512 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:16.925963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:16.926379 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:16.939591 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] HTTP exception thrown: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Request method failure captured: Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: DELETE /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a HTTP/1.1 Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6J_hCJAl2H-NIYlCVz1Gvx5UiROgxTRL0ZtULUL384TmlOwwe4393kTRXtPihroKh1IRLd0Y14YIrVrhPN6lED0uQ4-pW1Nt3tMsCZ2KTPVQGtupdoikeBBmO-LrhtKnvHvGS944ue8ewqB9q-bVFgTnBPPsIkOhr4keDCBEGG-C4 Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 74f3f1161ef84f30bbd787e9361a0dac Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:09:16.941085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/74f3f1161ef84f30bbd787e9361a0dac"}]}] Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 74f3f1161ef84f30bbd787e9361a0dac Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-DeleteServersTestJSON-1723207272-project Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: cc580d348f154c4488a5f84640539655 Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-DeleteServersTestJSON-1723207272-project Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:16.942537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '79f5cf3f-d9c5-4279-a896-d6dd9c50266a'} Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:09:16.943345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:16.944733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:16.946186 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Returning 404 to user: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:09:16.946186 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ff39b430-7361-476d-bba3-acff792d9827 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "DELETE /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 404 len: 111 microversion: 2.1 time: 0.030673 Aug 29 19:09:16.946186 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 116/243] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:09:16 2022] DELETE /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:09:16.951030 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:16.951696 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] [instance: 79f5cf3f-d9c5-4279-a896-d6dd9c50266a] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:16.957683 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:16.958166 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:16.958627 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:16.959338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:16.959824 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:16.960250 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:16.974375 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] HTTP exception thrown: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Request method failure captured: Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a HTTP/1.1 Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6J_hCJAl2H-NIYlCVz1Gvx5UiROgxTRL0ZtULUL384TmlOwwe4393kTRXtPihroKh1IRLd0Y14YIrVrhPN6lED0uQ4-pW1Nt3tMsCZ2KTPVQGtupdoikeBBmO-LrhtKnvHvGS944ue8ewqB9q-bVFgTnBPPsIkOhr4keDCBEGG-C4 Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 74f3f1161ef84f30bbd787e9361a0dac Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:09:16.980201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/74f3f1161ef84f30bbd787e9361a0dac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/74f3f1161ef84f30bbd787e9361a0dac"}]}] Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 74f3f1161ef84f30bbd787e9361a0dac Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-DeleteServersTestJSON-1723207272 Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-DeleteServersTestJSON-1723207272-project Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: cc580d348f154c4488a5f84640539655 Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-DeleteServersTestJSON-1723207272-project Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:16.981719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '79f5cf3f-d9c5-4279-a896-d6dd9c50266a'} Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:09:16.982510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. Aug 29 19:09:16.983654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:16.984620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] Returning 404 to user: Instance 79f5cf3f-d9c5-4279-a896-d6dd9c50266a could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:09:16.984620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6738c402-f14e-4ce3-aa4a-311445eecc80 tempest-DeleteServersTestJSON-1723207272 tempest-DeleteServersTestJSON-1723207272-project] 10.222.0.94 "GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a" status: 404 len: 111 microversion: 2.1 time: 0.034554 Aug 29 19:09:16.984620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 128/244] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:16 2022] GET /compute/v2.1/servers/79f5cf3f-d9c5-4279-a896-d6dd9c50266a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:09:16.984805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1630ce4e-ff70-4d56-acf9-5612047f3d0a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:16.984805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1630ce4e-ff70-4d56-acf9-5612047f3d0a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:16.989626 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1630ce4e-ff70-4d56-acf9-5612047f3d0a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:16.990047 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1630ce4e-ff70-4d56-acf9-5612047f3d0a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:16.990476 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1630ce4e-ff70-4d56-acf9-5612047f3d0a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:16.991195 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1630ce4e-ff70-4d56-acf9-5612047f3d0a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:16.993128 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1630ce4e-ff70-4d56-acf9-5612047f3d0a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:16.993562 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1630ce4e-ff70-4d56-acf9-5612047f3d0a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:17.147477 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1630ce4e-ff70-4d56-acf9-5612047f3d0a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:17.161768 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1630ce4e-ff70-4d56-acf9-5612047f3d0a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.182093 Aug 29 19:09:17.163773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 117/245] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:16 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:17.840518 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8b716ebf-b548-4074-bfe9-54b844559e41 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:17.841147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8b716ebf-b548-4074-bfe9-54b844559e41 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:17.855158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b716ebf-b548-4074-bfe9-54b844559e41 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:17.856163 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b716ebf-b548-4074-bfe9-54b844559e41 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:17.858223 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b716ebf-b548-4074-bfe9-54b844559e41 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:17.859206 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b716ebf-b548-4074-bfe9-54b844559e41 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:17.859881 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b716ebf-b548-4074-bfe9-54b844559e41 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:17.860944 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b716ebf-b548-4074-bfe9-54b844559e41 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:17.899540 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:17.993784 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8b716ebf-b548-4074-bfe9-54b844559e41 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:18.005967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8b716ebf-b548-4074-bfe9-54b844559e41 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1272 microversion: 2.1 time: 0.166436 Aug 29 19:09:18.006683 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 129/246] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:17 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:18.187632 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-bd732c79-ab94-4149-b276-1bdec67cf8bd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:18.188336 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-bd732c79-ab94-4149-b276-1bdec67cf8bd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:18.200026 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd732c79-ab94-4149-b276-1bdec67cf8bd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:18.206199 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd732c79-ab94-4149-b276-1bdec67cf8bd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:18.206805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd732c79-ab94-4149-b276-1bdec67cf8bd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:18.212032 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd732c79-ab94-4149-b276-1bdec67cf8bd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:18.212524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd732c79-ab94-4149-b276-1bdec67cf8bd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:18.212956 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd732c79-ab94-4149-b276-1bdec67cf8bd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:18.644221 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-bd732c79-ab94-4149-b276-1bdec67cf8bd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:18.652483 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-bd732c79-ab94-4149-b276-1bdec67cf8bd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.470488 Aug 29 19:09:18.667592 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 118/247] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:18 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:18.998148 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-5768265b-357d-41cf-a635-ccfebe1b7b75 req-b1af8aae-215a-4667-87d8-7b18fe0e7e56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "932ea63e-1e18-489e-b007-cba85d8ab0cf", "tag": "7c82c12f-9d4e-485c-8e6c-55f4ff85124c"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:19.015287 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-5768265b-357d-41cf-a635-ccfebe1b7b75 req-b1af8aae-215a-4667-87d8-7b18fe0e7e56 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:19.015785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-5768265b-357d-41cf-a635-ccfebe1b7b75 req-b1af8aae-215a-4667-87d8-7b18fe0e7e56 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:19.017540 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-5768265b-357d-41cf-a635-ccfebe1b7b75 req-b1af8aae-215a-4667-87d8-7b18fe0e7e56 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:19.038555 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f9f09ab5-afa1-449d-8eca-c175b8127a47 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:19.039385 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f9f09ab5-afa1-449d-8eca-c175b8127a47 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:19.045639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-5768265b-357d-41cf-a635-ccfebe1b7b75 req-b1af8aae-215a-4667-87d8-7b18fe0e7e56 service nova] Creating event network-changed:7c82c12f-9d4e-485c-8e6c-55f4ff85124c for instance 932ea63e-1e18-489e-b007-cba85d8ab0cf on hv-cinder-73126 Aug 29 19:09:19.048743 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f9f09ab5-afa1-449d-8eca-c175b8127a47 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:19.051683 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f9f09ab5-afa1-449d-8eca-c175b8127a47 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:19.052011 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f9f09ab5-afa1-449d-8eca-c175b8127a47 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:19.052729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f9f09ab5-afa1-449d-8eca-c175b8127a47 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:19.053133 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f9f09ab5-afa1-449d-8eca-c175b8127a47 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:19.053563 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f9f09ab5-afa1-449d-8eca-c175b8127a47 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:19.058183 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-5768265b-357d-41cf-a635-ccfebe1b7b75 req-b1af8aae-215a-4667-87d8-7b18fe0e7e56 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071194 Aug 29 19:09:19.059003 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 130/248] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:19.368904 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f9f09ab5-afa1-449d-8eca-c175b8127a47 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:19.378294 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f9f09ab5-afa1-449d-8eca-c175b8127a47 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1314 microversion: 2.1 time: 0.345875 Aug 29 19:09:19.381639 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 119/249] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:19 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:19.678840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3b6b5e02-c349-4db6-8655-5dada6682ad8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:19.680674 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3b6b5e02-c349-4db6-8655-5dada6682ad8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:19.693265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b6b5e02-c349-4db6-8655-5dada6682ad8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:19.694227 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b6b5e02-c349-4db6-8655-5dada6682ad8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:19.695521 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b6b5e02-c349-4db6-8655-5dada6682ad8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:19.696472 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b6b5e02-c349-4db6-8655-5dada6682ad8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:19.697221 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b6b5e02-c349-4db6-8655-5dada6682ad8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:19.697867 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b6b5e02-c349-4db6-8655-5dada6682ad8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:19.942592 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3b6b5e02-c349-4db6-8655-5dada6682ad8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:19.967157 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3b6b5e02-c349-4db6-8655-5dada6682ad8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.295190 Aug 29 19:09:19.967796 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 131/250] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:19 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:20.402802 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1d1ada51-8607-4818-94bc-ef31c5e12e71 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:20.404278 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1d1ada51-8607-4818-94bc-ef31c5e12e71 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:20.418802 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1d1ada51-8607-4818-94bc-ef31c5e12e71 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:20.419333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1d1ada51-8607-4818-94bc-ef31c5e12e71 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:20.419779 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1d1ada51-8607-4818-94bc-ef31c5e12e71 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:20.420489 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1d1ada51-8607-4818-94bc-ef31c5e12e71 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:20.420946 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1d1ada51-8607-4818-94bc-ef31c5e12e71 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:20.421369 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1d1ada51-8607-4818-94bc-ef31c5e12e71 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:20.896549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1d1ada51-8607-4818-94bc-ef31c5e12e71 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:20.906771 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1d1ada51-8607-4818-94bc-ef31c5e12e71 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1314 microversion: 2.1 time: 0.508117 Aug 29 19:09:20.907944 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 120/251] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:20 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:20.990306 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-441f723e-26c1-4802-822d-57c53ccdb200 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:20.990921 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-441f723e-26c1-4802-822d-57c53ccdb200 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:21.011671 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-441f723e-26c1-4802-822d-57c53ccdb200 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:21.013014 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-441f723e-26c1-4802-822d-57c53ccdb200 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:21.013677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-441f723e-26c1-4802-822d-57c53ccdb200 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:21.014593 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-441f723e-26c1-4802-822d-57c53ccdb200 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:21.015242 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-441f723e-26c1-4802-822d-57c53ccdb200 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:21.015934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-441f723e-26c1-4802-822d-57c53ccdb200 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:21.196145 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-441f723e-26c1-4802-822d-57c53ccdb200 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:21.205160 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-441f723e-26c1-4802-822d-57c53ccdb200 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.219840 Aug 29 19:09:21.211413 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 132/252] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:20 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:21.929335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e4f8e577-5f06-4027-ac01-ffe3985932ef tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:21.930861 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e4f8e577-5f06-4027-ac01-ffe3985932ef tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:21.938203 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4f8e577-5f06-4027-ac01-ffe3985932ef tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:21.938849 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4f8e577-5f06-4027-ac01-ffe3985932ef tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:21.939623 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4f8e577-5f06-4027-ac01-ffe3985932ef tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:21.940475 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4f8e577-5f06-4027-ac01-ffe3985932ef tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:21.941022 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4f8e577-5f06-4027-ac01-ffe3985932ef tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:21.941557 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4f8e577-5f06-4027-ac01-ffe3985932ef tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:22.228013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5273a88d-891e-4a48-a949-166cda454656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:22.229214 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5273a88d-891e-4a48-a949-166cda454656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:22.235382 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5273a88d-891e-4a48-a949-166cda454656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:22.235868 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5273a88d-891e-4a48-a949-166cda454656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:22.236301 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5273a88d-891e-4a48-a949-166cda454656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:22.236997 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5273a88d-891e-4a48-a949-166cda454656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:22.237448 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5273a88d-891e-4a48-a949-166cda454656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:22.237873 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5273a88d-891e-4a48-a949-166cda454656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:22.394792 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e4f8e577-5f06-4027-ac01-ffe3985932ef tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:22.410533 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e4f8e577-5f06-4027-ac01-ffe3985932ef tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1314 microversion: 2.1 time: 0.485414 Aug 29 19:09:22.420230 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 121/253] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:21 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:22.444260 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5273a88d-891e-4a48-a949-166cda454656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:22.454168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5273a88d-891e-4a48-a949-166cda454656 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.230631 Aug 29 19:09:22.468513 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 133/254] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:22 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:23.338477 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fb47d404-02e2-40de-acc4-0bd90bc2eb57 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Action: 'create', calling method: .version_select at 0x7f3d764f4ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-842989866"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:23.431690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cb1be6e1-c994-48b8-990a-a883faa7aa5e tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:23.432300 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cb1be6e1-c994-48b8-990a-a883faa7aa5e tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:23.438273 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb1be6e1-c994-48b8-990a-a883faa7aa5e tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.438759 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb1be6e1-c994-48b8-990a-a883faa7aa5e tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.439214 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb1be6e1-c994-48b8-990a-a883faa7aa5e tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.439902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb1be6e1-c994-48b8-990a-a883faa7aa5e tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.440351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb1be6e1-c994-48b8-990a-a883faa7aa5e tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.440769 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb1be6e1-c994-48b8-990a-a883faa7aa5e tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.615528 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cb1be6e1-c994-48b8-990a-a883faa7aa5e tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:23.625637 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cb1be6e1-c994-48b8-990a-a883faa7aa5e tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1314 microversion: 2.1 time: 0.197646 Aug 29 19:09:23.626267 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 134/255] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:23 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:23.631186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-95ac21c0-d336-44dc-b2fc-3bd7cefd121b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:23.632016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-95ac21c0-d336-44dc-b2fc-3bd7cefd121b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:23.638821 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95ac21c0-d336-44dc-b2fc-3bd7cefd121b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.640239 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95ac21c0-d336-44dc-b2fc-3bd7cefd121b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.640843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95ac21c0-d336-44dc-b2fc-3bd7cefd121b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.641547 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95ac21c0-d336-44dc-b2fc-3bd7cefd121b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:23.642005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95ac21c0-d336-44dc-b2fc-3bd7cefd121b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:23.642430 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95ac21c0-d336-44dc-b2fc-3bd7cefd121b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:23.702367 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fb47d404-02e2-40de-acc4-0bd90bc2eb57 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.506799 Aug 29 19:09:23.703795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 122/256] 10.222.0.94 () {60 vars in 1155 bytes} [Mon Aug 29 19:09:23 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 509 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 29 19:09:23.715776 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9f8b920a-60fb-4f22-b719-cb3abf5e9e3e tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d76664160>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:23.768307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9f8b920a-60fb-4f22-b719-cb3abf5e9e3e tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4" status: 200 len: 344 microversion: 2.1 time: 0.056167 Aug 29 19:09:23.774734 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 123/257] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:09:23 2022] GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:09:23.794210 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-95ac21c0-d336-44dc-b2fc-3bd7cefd121b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:23.801915 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-95ac21c0-d336-44dc-b2fc-3bd7cefd121b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.174455 Aug 29 19:09:23.802486 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 135/258] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:23 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:24.649123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-97e42db4-6f77-471a-a825-4014f110b686 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:24.649988 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-97e42db4-6f77-471a-a825-4014f110b686 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:24.656313 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-97e42db4-6f77-471a-a825-4014f110b686 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:24.657052 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-97e42db4-6f77-471a-a825-4014f110b686 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:24.657673 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-97e42db4-6f77-471a-a825-4014f110b686 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:24.658364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-97e42db4-6f77-471a-a825-4014f110b686 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:24.658813 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-97e42db4-6f77-471a-a825-4014f110b686 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:24.659438 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-97e42db4-6f77-471a-a825-4014f110b686 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:24.784002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a39aa5b4-673e-4cd6-b8f1-22f87f79cd74 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d76659700>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:24.847247 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-97e42db4-6f77-471a-a825-4014f110b686 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:24.848740 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-97e42db4-6f77-471a-a825-4014f110b686 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1314 microversion: 2.1 time: 0.204147 Aug 29 19:09:24.850216 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 124/259] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:24 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:24.861644 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5bed737f-934f-40ec-bbcd-61ebadd8d116 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:24.862269 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5bed737f-934f-40ec-bbcd-61ebadd8d116 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:24.874804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bed737f-934f-40ec-bbcd-61ebadd8d116 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:24.875658 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bed737f-934f-40ec-bbcd-61ebadd8d116 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:24.876110 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bed737f-934f-40ec-bbcd-61ebadd8d116 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:24.876826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bed737f-934f-40ec-bbcd-61ebadd8d116 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:24.877545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bed737f-934f-40ec-bbcd-61ebadd8d116 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:24.877980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bed737f-934f-40ec-bbcd-61ebadd8d116 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:24.939876 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a39aa5b4-673e-4cd6-b8f1-22f87f79cd74 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4" status: 200 len: 345 microversion: 2.1 time: 0.161111 Aug 29 19:09:24.940453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 136/260] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:09:24 2022] GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4 => generated 345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:24.954678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fe1dc81c-6688-4dff-b4fe-d96dbafe00ad tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Action: 'create', calling method: .version_select at 0x7f3d765c41f0>, body: {"snapshot": {"volume_id": "6d55d1e5-6da1-4050-9a72-d92388f5d6b4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1174255047"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:25.113300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5bed737f-934f-40ec-bbcd-61ebadd8d116 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:25.123975 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5bed737f-934f-40ec-bbcd-61ebadd8d116 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.272251 Aug 29 19:09:25.139351 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 125/261] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:24 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:25.163745 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fe1dc81c-6688-4dff-b4fe-d96dbafe00ad tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.213909 Aug 29 19:09:25.165544 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 137/262] 10.222.0.94 () {60 vars in 1162 bytes} [Mon Aug 29 19:09:24 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:25.176846 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-56f36be2-f369-4da0-8e25-41f37e525ddd tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d76629f70>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:25.214361 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-56f36be2-f369-4da0-8e25-41f37e525ddd tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79" status: 200 len: 287 microversion: 2.1 time: 0.041693 Aug 29 19:09:25.214928 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 126/263] 10.222.0.94 () {58 vars in 1251 bytes} [Mon Aug 29 19:09:25 2022] GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:25.225471 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5b32dd0b-8613-4ca6-8f51-57d55108a2ab tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d765c49d0>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:25.262438 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5b32dd0b-8613-4ca6-8f51-57d55108a2ab tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.040933 Aug 29 19:09:25.263552 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 138/264] 10.222.0.94 () {58 vars in 1140 bytes} [Mon Aug 29 19:09:25 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:25.279234 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6d1fb69c-8b35-43a9-ac2a-45602f5e61e7 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d764f40d0>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:25.325185 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6d1fb69c-8b35-43a9-ac2a-45602f5e61e7 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79" status: 200 len: 287 microversion: 2.1 time: 0.054684 Aug 29 19:09:25.325776 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 127/265] 10.222.0.94 () {58 vars in 1251 bytes} [Mon Aug 29 19:09:25 2022] GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79 => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:25.866817 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:25.868797 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=8 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:25.873095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f723bf25-3677-4824-a940-ad48539b8238 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:25.873997 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f723bf25-3677-4824-a940-ad48539b8238 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:25.881512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f723bf25-3677-4824-a940-ad48539b8238 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:25.882027 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f723bf25-3677-4824-a940-ad48539b8238 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:25.882480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f723bf25-3677-4824-a940-ad48539b8238 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:25.883806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f723bf25-3677-4824-a940-ad48539b8238 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:25.884386 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f723bf25-3677-4824-a940-ad48539b8238 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:25.885005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f723bf25-3677-4824-a940-ad48539b8238 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:26.045674 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f723bf25-3677-4824-a940-ad48539b8238 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:26.053765 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f723bf25-3677-4824-a940-ad48539b8238 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1314 microversion: 2.1 time: 0.187865 Aug 29 19:09:26.054327 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 139/266] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:25 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:26.146083 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-678e477a-5433-4044-a046-daa54020cd54 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:26.146889 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-678e477a-5433-4044-a046-daa54020cd54 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:26.154667 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-678e477a-5433-4044-a046-daa54020cd54 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:26.155194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-678e477a-5433-4044-a046-daa54020cd54 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:26.155650 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-678e477a-5433-4044-a046-daa54020cd54 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:26.156338 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-678e477a-5433-4044-a046-daa54020cd54 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:26.157089 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-678e477a-5433-4044-a046-daa54020cd54 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:26.157531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-678e477a-5433-4044-a046-daa54020cd54 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:26.338671 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-440e4916-2933-480f-957f-62cd591a2efd tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d765cf670>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:26.346991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-678e477a-5433-4044-a046-daa54020cd54 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:26.356739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-678e477a-5433-4044-a046-daa54020cd54 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.214778 Aug 29 19:09:26.357526 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 128/267] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:26 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:26.369647 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-440e4916-2933-480f-957f-62cd591a2efd tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79" status: 200 len: 287 microversion: 2.1 time: 0.035738 Aug 29 19:09:26.370260 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 140/268] 10.222.0.94 () {58 vars in 1251 bytes} [Mon Aug 29 19:09:26 2022] GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:09:27.075245 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b459f4a4-0c07-4b9c-9078-02b65c6c57cf tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:27.075928 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b459f4a4-0c07-4b9c-9078-02b65c6c57cf tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:27.082036 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b459f4a4-0c07-4b9c-9078-02b65c6c57cf tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:27.082542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b459f4a4-0c07-4b9c-9078-02b65c6c57cf tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:27.082982 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b459f4a4-0c07-4b9c-9078-02b65c6c57cf tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:27.083714 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b459f4a4-0c07-4b9c-9078-02b65c6c57cf tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:27.084176 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b459f4a4-0c07-4b9c-9078-02b65c6c57cf tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:27.084995 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b459f4a4-0c07-4b9c-9078-02b65c6c57cf tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:27.218804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b459f4a4-0c07-4b9c-9078-02b65c6c57cf tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:27.227950 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b459f4a4-0c07-4b9c-9078-02b65c6c57cf tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1314 microversion: 2.1 time: 0.156670 Aug 29 19:09:27.228647 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 129/269] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:27 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:27.378897 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-363de315-ec6b-4c3c-bc02-b3b5ee45c12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:27.379547 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-363de315-ec6b-4c3c-bc02-b3b5ee45c12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:27.381556 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2daa8757-2221-4b45-b18c-7caeaf3c9a28 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d76629ee0>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:27.385764 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-363de315-ec6b-4c3c-bc02-b3b5ee45c12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:27.386288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-363de315-ec6b-4c3c-bc02-b3b5ee45c12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:27.386736 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-363de315-ec6b-4c3c-bc02-b3b5ee45c12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:27.387473 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-363de315-ec6b-4c3c-bc02-b3b5ee45c12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:27.387927 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-363de315-ec6b-4c3c-bc02-b3b5ee45c12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:27.388394 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-363de315-ec6b-4c3c-bc02-b3b5ee45c12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:27.413327 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2daa8757-2221-4b45-b18c-7caeaf3c9a28 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79" status: 200 len: 287 microversion: 2.1 time: 0.035608 Aug 29 19:09:27.415565 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 130/270] 10.222.0.94 () {58 vars in 1251 bytes} [Mon Aug 29 19:09:27 2022] GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:09:27.522205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-363de315-ec6b-4c3c-bc02-b3b5ee45c12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:27.530674 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-363de315-ec6b-4c3c-bc02-b3b5ee45c12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.156554 Aug 29 19:09:27.531279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 141/271] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:27 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:28.250074 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3b1aa971-4bd5-4ee9-82ac-c5492bd1f43f tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:28.250759 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3b1aa971-4bd5-4ee9-82ac-c5492bd1f43f tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:28.257213 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3b1aa971-4bd5-4ee9-82ac-c5492bd1f43f tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:28.257780 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3b1aa971-4bd5-4ee9-82ac-c5492bd1f43f tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:28.259009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3b1aa971-4bd5-4ee9-82ac-c5492bd1f43f tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:28.259541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3b1aa971-4bd5-4ee9-82ac-c5492bd1f43f tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:28.260000 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3b1aa971-4bd5-4ee9-82ac-c5492bd1f43f tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:28.260429 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3b1aa971-4bd5-4ee9-82ac-c5492bd1f43f tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:28.387319 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3b1aa971-4bd5-4ee9-82ac-c5492bd1f43f tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:28.395141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3b1aa971-4bd5-4ee9-82ac-c5492bd1f43f tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1314 microversion: 2.1 time: 0.149512 Aug 29 19:09:28.396086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 131/272] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:28 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:28.426757 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-04f80fe8-f89c-43f4-8f38-982bd4460cf8 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d765cf430>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:28.456448 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-04f80fe8-f89c-43f4-8f38-982bd4460cf8 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79" status: 200 len: 287 microversion: 2.1 time: 0.033469 Aug 29 19:09:28.457021 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 142/273] 10.222.0.94 () {58 vars in 1251 bytes} [Mon Aug 29 19:09:28 2022] GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:28.551947 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c5b50da4-25c0-45c4-9c75-32f97da334d4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:28.552557 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c5b50da4-25c0-45c4-9c75-32f97da334d4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:28.558790 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5b50da4-25c0-45c4-9c75-32f97da334d4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:28.559329 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5b50da4-25c0-45c4-9c75-32f97da334d4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:28.559750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5b50da4-25c0-45c4-9c75-32f97da334d4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:28.560435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5b50da4-25c0-45c4-9c75-32f97da334d4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:28.560892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5b50da4-25c0-45c4-9c75-32f97da334d4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:28.561317 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c5b50da4-25c0-45c4-9c75-32f97da334d4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:28.579727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:28.698932 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c5b50da4-25c0-45c4-9c75-32f97da334d4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:28.707099 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c5b50da4-25c0-45c4-9c75-32f97da334d4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.159050 Aug 29 19:09:28.707688 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 132/274] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:28 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:28.735016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-6656cd2c-06fb-40bc-af8e-19177c5eaf09 req-37bf2ec3-8abe-49d4-b536-523dd77e033a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932ea63e-1e18-489e-b007-cba85d8ab0cf", "name": "network-vif-plugged", "status": "completed", "tag": "7c82c12f-9d4e-485c-8e6c-55f4ff85124c"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:28.745750 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-6656cd2c-06fb-40bc-af8e-19177c5eaf09 req-37bf2ec3-8abe-49d4-b536-523dd77e033a service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:28.746312 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-6656cd2c-06fb-40bc-af8e-19177c5eaf09 req-37bf2ec3-8abe-49d4-b536-523dd77e033a service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:28.747085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-6656cd2c-06fb-40bc-af8e-19177c5eaf09 req-37bf2ec3-8abe-49d4-b536-523dd77e033a service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:28.758472 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-6656cd2c-06fb-40bc-af8e-19177c5eaf09 req-37bf2ec3-8abe-49d4-b536-523dd77e033a service nova] Creating event network-vif-plugged:7c82c12f-9d4e-485c-8e6c-55f4ff85124c for instance 932ea63e-1e18-489e-b007-cba85d8ab0cf on hv-cinder-73126 Aug 29 19:09:28.763600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-6656cd2c-06fb-40bc-af8e-19177c5eaf09 req-37bf2ec3-8abe-49d4-b536-523dd77e033a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033318 Aug 29 19:09:28.764280 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 143/275] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:29.418596 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7a2c8d64-07c9-4cab-ad8f-22b736e23bc5 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:29.420745 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7a2c8d64-07c9-4cab-ad8f-22b736e23bc5 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:29.422764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=54 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:29.442038 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a2c8d64-07c9-4cab-ad8f-22b736e23bc5 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:29.443102 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a2c8d64-07c9-4cab-ad8f-22b736e23bc5 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:29.444982 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a2c8d64-07c9-4cab-ad8f-22b736e23bc5 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:29.444982 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a2c8d64-07c9-4cab-ad8f-22b736e23bc5 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:29.447489 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a2c8d64-07c9-4cab-ad8f-22b736e23bc5 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:29.448064 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7a2c8d64-07c9-4cab-ad8f-22b736e23bc5 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:29.470860 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6b3bc4b1-012a-4655-8027-3faf8493ea73 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d765cfb80>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:29.510912 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6b3bc4b1-012a-4655-8027-3faf8493ea73 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79" status: 200 len: 288 microversion: 2.1 time: 0.044706 Aug 29 19:09:29.512055 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 144/276] 10.222.0.94 () {58 vars in 1251 bytes} [Mon Aug 29 19:09:29 2022] GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79 => generated 288 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:29.522553 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-280c0ce4-154e-4c15-98f6-b9c6a0d5fea2 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d76659d30>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:29.599033 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-280c0ce4-154e-4c15-98f6-b9c6a0d5fea2 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "DELETE /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79" status: 202 len: 0 microversion: 2.1 time: 0.080242 Aug 29 19:09:29.599629 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 145/277] 10.222.0.94 () {58 vars in 1254 bytes} [Mon Aug 29 19:09:29 2022] DELETE /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:09:29.603589 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7a2c8d64-07c9-4cab-ad8f-22b736e23bc5 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:29.604959 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2111270656", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "networks": [{"uuid": "52476fb5-9ab9-4464-9daf-e0ff6b32722a"}]}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:29.611786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7a2c8d64-07c9-4cab-ad8f-22b736e23bc5 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1314 microversion: 2.1 time: 0.197840 Aug 29 19:09:29.612423 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 133/278] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:29 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:29.616779 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d16d126b-323d-4540-950c-41cf02dc808a tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d764f8af0>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:29.656602 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d16d126b-323d-4540-950c-41cf02dc808a tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79" status: 200 len: 287 microversion: 2.1 time: 0.043154 Aug 29 19:09:29.657650 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 134/279] 10.222.0.94 () {58 vars in 1251 bytes} [Mon Aug 29 19:09:29 2022] GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:29.664903 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] validate_networks() for [('52476fb5-9ab9-4464-9daf-e0ff6b32722a', None, None, None, None, None)] {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:09:29.728906 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-05b0ce7c-86c2-4cec-86a3-af0d2288bf03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:29.729688 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-05b0ce7c-86c2-4cec-86a3-af0d2288bf03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:29.735835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b0ce7c-86c2-4cec-86a3-af0d2288bf03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:29.736325 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b0ce7c-86c2-4cec-86a3-af0d2288bf03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:29.736766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b0ce7c-86c2-4cec-86a3-af0d2288bf03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:29.737463 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b0ce7c-86c2-4cec-86a3-af0d2288bf03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:29.737922 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b0ce7c-86c2-4cec-86a3-af0d2288bf03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:29.738350 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b0ce7c-86c2-4cec-86a3-af0d2288bf03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:29.955728 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-05b0ce7c-86c2-4cec-86a3-af0d2288bf03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:29.965229 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-05b0ce7c-86c2-4cec-86a3-af0d2288bf03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.240824 Aug 29 19:09:29.978821 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 135/280] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:29 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:30.088617 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:09:30.089067 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:09:30.089524 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:09:30.089939 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:09:30.090390 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:09:30.099341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:30.099839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:30.100279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:30.101008 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:30.102356 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:30.102891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:30.121108 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Getting quotas for project 778d0dad05594da5bb3cb0e2efcb2af5. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:09:30.125205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Getting quotas for user 985dfcc7246c45b5b470e07957cd2f49 and project 778d0dad05594da5bb3cb0e2efcb2af5. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:09:30.137052 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:09:30.139530 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:09:30.184935 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-58ad37e6-276c-4776-b991-125f15959769 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.584219 Aug 29 19:09:30.185581 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 146/281] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:09:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:09:30.197056 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c5cb8a33-0b78-485f-b34b-47e9fbaecda3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:30.197665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c5cb8a33-0b78-485f-b34b-47e9fbaecda3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:30.250474 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c5cb8a33-0b78-485f-b34b-47e9fbaecda3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:30.258707 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c5cb8a33-0b78-485f-b34b-47e9fbaecda3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1219 microversion: 2.1 time: 0.065402 Aug 29 19:09:30.259728 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 136/282] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:30 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:30.635618 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e7f44295-4482-4e54-983d-05e02629430a tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:30.636909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e7f44295-4482-4e54-983d-05e02629430a tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:30.639089 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:30.647825 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e7f44295-4482-4e54-983d-05e02629430a tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:30.648403 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e7f44295-4482-4e54-983d-05e02629430a tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:30.648864 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e7f44295-4482-4e54-983d-05e02629430a tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:30.649614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e7f44295-4482-4e54-983d-05e02629430a tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:30.650115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e7f44295-4482-4e54-983d-05e02629430a tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:30.650751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e7f44295-4482-4e54-983d-05e02629430a tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:30.669789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d19f9723-8f51-4fc6-9e81-e11dbf5c60eb tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d76725940>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:30.698136 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-d19f9723-8f51-4fc6-9e81-e11dbf5c60eb tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] HTTP exception thrown: Snapshot 407cb958-3c74-4aa0-a465-9b8b83b8dc79 could not be found. Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d19f9723-8f51-4fc6-9e81-e11dbf5c60eb tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Request method failure captured: Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79 HTTP/1.1 Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ7jjm7M3LZLxWE_KRgyfLaPTjzG9JAWsH17ufj7zX-ntIaFtK7VUpMVWtdtdNcQVHlGqSU9GT9Byuh8fNbwr-ppi5icjLfzZm9MWx17Oq7aFM4RGmE7tD4ORXV_E4kypcuQGxabkcC0mbQ4E4jMaV5FfI5YpJnWqS0HNs0MzQnuuLU Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 95fbab83c1c04b879461b820b1c5827f Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:09:30.701867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/95fbab83c1c04b879461b820b1c5827f"}]}] Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 95fbab83c1c04b879461b820b1c5827f Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-VolumesSnapshotsTestJSON-2039830577-project Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 849c01285b1a498b8418137a96a121a4 Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2039830577-project Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Snapshot 407cb958-3c74-4aa0-a465-9b8b83b8dc79 could not be found. Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '407cb958-3c74-4aa0-a465-9b8b83b8dc79'} Aug 29 19:09:30.703141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 407cb958-3c74-4aa0-a465-9b8b83b8dc79 could not be found. (HTTP 404) (Request-ID: req-fa8652ce-13f5-4399-a173-e7a918573f9d) Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:30.703954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:09:30.705027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 407cb958-3c74-4aa0-a465-9b8b83b8dc79 could not be found. Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 19:09:30.706126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 407cb958-3c74-4aa0-a465-9b8b83b8dc79 could not be found. Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 407cb958-3c74-4aa0-a465-9b8b83b8dc79 could not be found. Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d19f9723-8f51-4fc6-9e81-e11dbf5c60eb tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Returning 404 to user: Snapshot 407cb958-3c74-4aa0-a465-9b8b83b8dc79 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:09:30.707509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d19f9723-8f51-4fc6-9e81-e11dbf5c60eb tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79" status: 404 len: 111 microversion: 2.1 time: 0.037962 Aug 29 19:09:30.708361 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 137/283] 10.222.0.94 () {58 vars in 1251 bytes} [Mon Aug 29 19:09:30 2022] GET /compute/v2.1/os-snapshots/407cb958-3c74-4aa0-a465-9b8b83b8dc79 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:09:30.712169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3201aceb-a089-46c2-a52f-b3fb6373fc1e tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d7655c700>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:30.789526 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3201aceb-a089-46c2-a52f-b3fb6373fc1e tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4" status: 202 len: 0 microversion: 2.1 time: 0.080571 Aug 29 19:09:30.790365 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 138/284] 10.222.0.94 () {58 vars in 1248 bytes} [Mon Aug 29 19:09:30 2022] DELETE /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:09:30.799039 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-99fffa3b-c2ab-4553-85ba-79485725cbeb tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d764f45e0>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:30.817551 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e7f44295-4482-4e54-983d-05e02629430a tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:30.825556 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e7f44295-4482-4e54-983d-05e02629430a tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1464 microversion: 2.1 time: 0.195401 Aug 29 19:09:30.826126 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 147/285] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:30 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1464 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:30.859827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-99fffa3b-c2ab-4553-85ba-79485725cbeb tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4" status: 200 len: 344 microversion: 2.1 time: 0.064523 Aug 29 19:09:30.860688 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 139/286] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:09:30 2022] GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:09:30.889232 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-93d5dee3-ecf6-4de7-9e26-990613b8dd3c tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:30.890092 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-93d5dee3-ecf6-4de7-9e26-990613b8dd3c tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:30.895683 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93d5dee3-ecf6-4de7-9e26-990613b8dd3c tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:30.896231 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93d5dee3-ecf6-4de7-9e26-990613b8dd3c tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:30.896724 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93d5dee3-ecf6-4de7-9e26-990613b8dd3c tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:30.897420 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93d5dee3-ecf6-4de7-9e26-990613b8dd3c tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:30.897890 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93d5dee3-ecf6-4de7-9e26-990613b8dd3c tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:30.898389 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93d5dee3-ecf6-4de7-9e26-990613b8dd3c tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:30.925484 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-93d5dee3-ecf6-4de7-9e26-990613b8dd3c tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:09:30.986352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-46fdc581-b554-4e65-b3b6-fcbd7c879da2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:30.986964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-46fdc581-b554-4e65-b3b6-fcbd7c879da2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:30.993908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46fdc581-b554-4e65-b3b6-fcbd7c879da2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:30.994393 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46fdc581-b554-4e65-b3b6-fcbd7c879da2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:30.994827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46fdc581-b554-4e65-b3b6-fcbd7c879da2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:30.995546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46fdc581-b554-4e65-b3b6-fcbd7c879da2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:30.996002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46fdc581-b554-4e65-b3b6-fcbd7c879da2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:30.996424 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46fdc581-b554-4e65-b3b6-fcbd7c879da2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:31.003087 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-93d5dee3-ecf6-4de7-9e26-990613b8dd3c tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "DELETE /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 204 len: 0 microversion: 2.1 time: 0.117706 Aug 29 19:09:31.003680 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 148/287] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:09:30 2022] DELETE /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:09:31.012551 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-37586763-a054-47ef-bdac-203e43a2b932 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:31.013238 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-37586763-a054-47ef-bdac-203e43a2b932 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:31.018795 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-37586763-a054-47ef-bdac-203e43a2b932 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:31.019376 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-37586763-a054-47ef-bdac-203e43a2b932 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:31.019809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-37586763-a054-47ef-bdac-203e43a2b932 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:31.020490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-37586763-a054-47ef-bdac-203e43a2b932 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:31.020970 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-37586763-a054-47ef-bdac-203e43a2b932 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:31.021390 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-37586763-a054-47ef-bdac-203e43a2b932 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:31.186805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-46fdc581-b554-4e65-b3b6-fcbd7c879da2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:31.194768 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-46fdc581-b554-4e65-b3b6-fcbd7c879da2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.212166 Aug 29 19:09:31.196053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 140/288] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:30 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:31.208238 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-37586763-a054-47ef-bdac-203e43a2b932 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:31.216255 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-37586763-a054-47ef-bdac-203e43a2b932 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1470 microversion: 2.1 time: 0.207610 Aug 29 19:09:31.216826 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 149/289] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:31 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1470 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:31.281291 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-20d14c0c-da5f-485a-a53d-cfa7e740b16e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:31.282287 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-20d14c0c-da5f-485a-a53d-cfa7e740b16e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:31.288269 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20d14c0c-da5f-485a-a53d-cfa7e740b16e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:31.288758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20d14c0c-da5f-485a-a53d-cfa7e740b16e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:31.289321 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20d14c0c-da5f-485a-a53d-cfa7e740b16e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:31.290073 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20d14c0c-da5f-485a-a53d-cfa7e740b16e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:31.290545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20d14c0c-da5f-485a-a53d-cfa7e740b16e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:31.290962 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20d14c0c-da5f-485a-a53d-cfa7e740b16e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:31.361863 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-20d14c0c-da5f-485a-a53d-cfa7e740b16e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:31.370223 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-20d14c0c-da5f-485a-a53d-cfa7e740b16e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1223 microversion: 2.1 time: 0.092935 Aug 29 19:09:31.370794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 141/290] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:31 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:31.874032 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b6927b03-9595-438d-9061-1883917d30e5 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d765cf820>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:31.904404 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-b6927b03-9595-438d-9061-1883917d30e5 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] HTTP exception thrown: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b6927b03-9595-438d-9061-1883917d30e5 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Request method failure captured: Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4 HTTP/1.1 Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ7jjm7M3LZLxWE_KRgyfLaPTjzG9JAWsH17ufj7zX-ntIaFtK7VUpMVWtdtdNcQVHlGqSU9GT9Byuh8fNbwr-ppi5icjLfzZm9MWx17Oq7aFM4RGmE7tD4ORXV_E4kypcuQGxabkcC0mbQ4E4jMaV5FfI5YpJnWqS0HNs0MzQnuuLU Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 95fbab83c1c04b879461b820b1c5827f Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:09:31.908638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/95fbab83c1c04b879461b820b1c5827f"}]}] Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 95fbab83c1c04b879461b820b1c5827f Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-VolumesSnapshotsTestJSON-2039830577-project Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 849c01285b1a498b8418137a96a121a4 Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2039830577-project Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '6d55d1e5-6da1-4050-9a72-d92388f5d6b4'} Aug 29 19:09:31.910017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. (HTTP 404) (Request-ID: req-72c70065-1689-497e-bc42-579c4d9019d2) Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:31.910739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:09:31.912133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:09:31.913162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b6927b03-9595-438d-9061-1883917d30e5 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Returning 404 to user: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b6927b03-9595-438d-9061-1883917d30e5 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4" status: 404 len: 109 microversion: 2.1 time: 0.039876 Aug 29 19:09:31.914293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 150/291] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:09:31 2022] GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:09:31.925009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f9d2add7-78c9-4688-af71-14e95f2b2401 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d778d2040>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:31.959090 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-f9d2add7-78c9-4688-af71-14e95f2b2401 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] HTTP exception thrown: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f9d2add7-78c9-4688-af71-14e95f2b2401 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Request method failure captured: Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: DELETE /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4 HTTP/1.1 Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ7jjm7M3LZLxWE_KRgyfLaPTjzG9JAWsH17ufj7zX-ntIaFtK7VUpMVWtdtdNcQVHlGqSU9GT9Byuh8fNbwr-ppi5icjLfzZm9MWx17Oq7aFM4RGmE7tD4ORXV_E4kypcuQGxabkcC0mbQ4E4jMaV5FfI5YpJnWqS0HNs0MzQnuuLU Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 95fbab83c1c04b879461b820b1c5827f Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:09:31.961651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/95fbab83c1c04b879461b820b1c5827f"}]}] Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 95fbab83c1c04b879461b820b1c5827f Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-VolumesSnapshotsTestJSON-2039830577-project Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 849c01285b1a498b8418137a96a121a4 Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2039830577-project Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '6d55d1e5-6da1-4050-9a72-d92388f5d6b4'} Aug 29 19:09:31.963053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. (HTTP 404) (Request-ID: req-a308ddcf-3894-4707-9b36-20344934c10a) Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:31.963881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:09:31.964898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 19:09:31.965894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f9d2add7-78c9-4688-af71-14e95f2b2401 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Returning 404 to user: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f9d2add7-78c9-4688-af71-14e95f2b2401 tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4" status: 404 len: 109 microversion: 2.1 time: 0.042340 Aug 29 19:09:31.967738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 142/292] 10.222.0.94 () {58 vars in 1248 bytes} [Mon Aug 29 19:09:31 2022] DELETE /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:09:31.972199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-efb6c89e-33c2-497c-ba28-1c5c96d67c3c tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Calling method '.version_select at 0x7f3d765de1f0>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:32.002413 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-efb6c89e-33c2-497c-ba28-1c5c96d67c3c tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] HTTP exception thrown: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-efb6c89e-33c2-497c-ba28-1c5c96d67c3c tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Request method failure captured: Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4 HTTP/1.1 Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ7jjm7M3LZLxWE_KRgyfLaPTjzG9JAWsH17ufj7zX-ntIaFtK7VUpMVWtdtdNcQVHlGqSU9GT9Byuh8fNbwr-ppi5icjLfzZm9MWx17Oq7aFM4RGmE7tD4ORXV_E4kypcuQGxabkcC0mbQ4E4jMaV5FfI5YpJnWqS0HNs0MzQnuuLU Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 95fbab83c1c04b879461b820b1c5827f Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:09:32.004483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/95fbab83c1c04b879461b820b1c5827f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/95fbab83c1c04b879461b820b1c5827f"}]}] Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 95fbab83c1c04b879461b820b1c5827f Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2039830577 Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-VolumesSnapshotsTestJSON-2039830577-project Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 849c01285b1a498b8418137a96a121a4 Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2039830577-project Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '6d55d1e5-6da1-4050-9a72-d92388f5d6b4'} Aug 29 19:09:32.005923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. (HTTP 404) (Request-ID: req-2c4336e5-d2a0-4c9c-b0c6-e354e9e3aa44) Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:32.006782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:09:32.008713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:09:32.009747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-efb6c89e-33c2-497c-ba28-1c5c96d67c3c tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] Returning 404 to user: Volume 6d55d1e5-6da1-4050-9a72-d92388f5d6b4 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-efb6c89e-33c2-497c-ba28-1c5c96d67c3c tempest-VolumesSnapshotsTestJSON-2039830577 tempest-VolumesSnapshotsTestJSON-2039830577-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4" status: 404 len: 109 microversion: 2.1 time: 0.038114 Aug 29 19:09:32.011111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 151/293] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:09:31 2022] GET /compute/v2.1/os-volumes/6d55d1e5-6da1-4050-9a72-d92388f5d6b4 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:09:32.216704 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-51b2dac6-ebb1-4577-bead-09c353877411 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:32.217618 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-51b2dac6-ebb1-4577-bead-09c353877411 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:32.225460 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-51b2dac6-ebb1-4577-bead-09c353877411 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:32.225957 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-51b2dac6-ebb1-4577-bead-09c353877411 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:32.227420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-51b2dac6-ebb1-4577-bead-09c353877411 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:32.227968 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-51b2dac6-ebb1-4577-bead-09c353877411 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:32.228423 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-51b2dac6-ebb1-4577-bead-09c353877411 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:32.228852 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-51b2dac6-ebb1-4577-bead-09c353877411 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:32.237761 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e76ec02a-7065-4325-923c-8a2ede8d3337 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:32.238364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e76ec02a-7065-4325-923c-8a2ede8d3337 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:32.248651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e76ec02a-7065-4325-923c-8a2ede8d3337 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:32.249145 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e76ec02a-7065-4325-923c-8a2ede8d3337 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:32.249575 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e76ec02a-7065-4325-923c-8a2ede8d3337 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:32.250279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e76ec02a-7065-4325-923c-8a2ede8d3337 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:32.250745 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e76ec02a-7065-4325-923c-8a2ede8d3337 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:32.251177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e76ec02a-7065-4325-923c-8a2ede8d3337 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:32.511475 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-51b2dac6-ebb1-4577-bead-09c353877411 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:32.519297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-51b2dac6-ebb1-4577-bead-09c353877411 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.306715 Aug 29 19:09:32.519857 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 143/294] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:32 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:32.527877 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e76ec02a-7065-4325-923c-8a2ede8d3337 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:32.542738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-76e19d11-471e-40df-b2f9-7df1f524cf1b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:32.544051 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-76e19d11-471e-40df-b2f9-7df1f524cf1b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:32.550046 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e76ec02a-7065-4325-923c-8a2ede8d3337 tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1470 microversion: 2.1 time: 0.315672 Aug 29 19:09:32.552059 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 152/295] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:32 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1470 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:32.552641 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76e19d11-471e-40df-b2f9-7df1f524cf1b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:32.553437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76e19d11-471e-40df-b2f9-7df1f524cf1b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:32.553942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76e19d11-471e-40df-b2f9-7df1f524cf1b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:32.555622 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76e19d11-471e-40df-b2f9-7df1f524cf1b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:32.556087 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76e19d11-471e-40df-b2f9-7df1f524cf1b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:32.556512 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76e19d11-471e-40df-b2f9-7df1f524cf1b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:32.637005 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-76e19d11-471e-40df-b2f9-7df1f524cf1b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:32.645128 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-76e19d11-471e-40df-b2f9-7df1f524cf1b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1223 microversion: 2.1 time: 0.123970 Aug 29 19:09:32.645793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 144/296] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:32 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1223 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:33.556141 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ea59150b-157c-4903-8bf2-9b2abde952c4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:33.556756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ea59150b-157c-4903-8bf2-9b2abde952c4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:33.562739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea59150b-157c-4903-8bf2-9b2abde952c4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:33.563267 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea59150b-157c-4903-8bf2-9b2abde952c4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:33.563701 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea59150b-157c-4903-8bf2-9b2abde952c4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:33.564584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea59150b-157c-4903-8bf2-9b2abde952c4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:33.565039 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea59150b-157c-4903-8bf2-9b2abde952c4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:33.565455 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea59150b-157c-4903-8bf2-9b2abde952c4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:33.580637 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-29523f0d-1507-4db5-adfb-3872f84d63de tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:33.582342 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-29523f0d-1507-4db5-adfb-3872f84d63de tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:33.592683 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29523f0d-1507-4db5-adfb-3872f84d63de tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:33.593263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29523f0d-1507-4db5-adfb-3872f84d63de tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:33.593897 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29523f0d-1507-4db5-adfb-3872f84d63de tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:33.594947 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29523f0d-1507-4db5-adfb-3872f84d63de tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:33.595640 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29523f0d-1507-4db5-adfb-3872f84d63de tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:33.596104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29523f0d-1507-4db5-adfb-3872f84d63de tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:33.920469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ea59150b-157c-4903-8bf2-9b2abde952c4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:33.927548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-29523f0d-1507-4db5-adfb-3872f84d63de tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:33.938542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-29523f0d-1507-4db5-adfb-3872f84d63de tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1470 microversion: 2.1 time: 0.364987 Aug 29 19:09:33.939782 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 145/297] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:33 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1470 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:33.955386 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f1b7dc9c-cb33-442f-86bc-1898bc93da7d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:33.955559 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ea59150b-157c-4903-8bf2-9b2abde952c4 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.389335 Aug 29 19:09:33.955933 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f1b7dc9c-cb33-442f-86bc-1898bc93da7d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:33.956563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 153/298] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:33 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:33.971412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1b7dc9c-cb33-442f-86bc-1898bc93da7d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:33.971911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1b7dc9c-cb33-442f-86bc-1898bc93da7d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:33.972676 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1b7dc9c-cb33-442f-86bc-1898bc93da7d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:33.974213 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1b7dc9c-cb33-442f-86bc-1898bc93da7d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:33.974784 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1b7dc9c-cb33-442f-86bc-1898bc93da7d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:33.976958 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f1b7dc9c-cb33-442f-86bc-1898bc93da7d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:34.097088 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f1b7dc9c-cb33-442f-86bc-1898bc93da7d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:34.110807 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f1b7dc9c-cb33-442f-86bc-1898bc93da7d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1279 microversion: 2.1 time: 0.169742 Aug 29 19:09:34.111436 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 146/299] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:33 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1279 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:34.240328 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-6c519113-34ea-4587-a060-ac4610a5492f req-99927fa5-b14d-4e4c-a73f-d22bd2f96f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "932ea63e-1e18-489e-b007-cba85d8ab0cf", "name": "network-vif-deleted", "tag": "7c82c12f-9d4e-485c-8e6c-55f4ff85124c"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:34.252828 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-6c519113-34ea-4587-a060-ac4610a5492f req-99927fa5-b14d-4e4c-a73f-d22bd2f96f3d service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:34.253523 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-6c519113-34ea-4587-a060-ac4610a5492f req-99927fa5-b14d-4e4c-a73f-d22bd2f96f3d service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:34.254097 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-6c519113-34ea-4587-a060-ac4610a5492f req-99927fa5-b14d-4e4c-a73f-d22bd2f96f3d service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:34.266763 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-6c519113-34ea-4587-a060-ac4610a5492f req-99927fa5-b14d-4e4c-a73f-d22bd2f96f3d service nova] Creating event network-vif-deleted:7c82c12f-9d4e-485c-8e6c-55f4ff85124c for instance 932ea63e-1e18-489e-b007-cba85d8ab0cf on hv-cinder-73126 Aug 29 19:09:34.273155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-6c519113-34ea-4587-a060-ac4610a5492f req-99927fa5-b14d-4e4c-a73f-d22bd2f96f3d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036387 Aug 29 19:09:34.273772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 154/300] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:34.962566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:34.964049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:34.976241 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:34.980196 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:34.981097 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:34.981478 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b45a5456-dc6b-4eab-9d80-0a9c4f9bd1be tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:34.982873 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b45a5456-dc6b-4eab-9d80-0a9c4f9bd1be tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:34.982997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:34.986628 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:34.987126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:35.001961 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b45a5456-dc6b-4eab-9d80-0a9c4f9bd1be tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:35.002837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b45a5456-dc6b-4eab-9d80-0a9c4f9bd1be tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:35.004177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b45a5456-dc6b-4eab-9d80-0a9c4f9bd1be tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:35.005129 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b45a5456-dc6b-4eab-9d80-0a9c4f9bd1be tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:35.006035 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b45a5456-dc6b-4eab-9d80-0a9c4f9bd1be tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:35.006485 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b45a5456-dc6b-4eab-9d80-0a9c4f9bd1be tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:35.064990 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:35.065498 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:35.065938 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:35.066396 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lazy-loading 'fault' on Instance uuid 932ea63e-1e18-489e-b007-cba85d8ab0cf {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:09:35.192687 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c27047dbc2c40de89017865e41a0dc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f594096296743c583bf3f8e0c1f5110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:35.207662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0c0ce064-ec68-446e-8895-e47f373ed54b tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 200 len: 1304 microversion: 2.1 time: 0.250012 Aug 29 19:09:35.208572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 147/301] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:34 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 1304 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:35.215649 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d632ee40-765b-4e66-8b2a-17420d65f923 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:35.217169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d632ee40-765b-4e66-8b2a-17420d65f923 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:35.225256 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d632ee40-765b-4e66-8b2a-17420d65f923 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:35.225912 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d632ee40-765b-4e66-8b2a-17420d65f923 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:35.226372 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d632ee40-765b-4e66-8b2a-17420d65f923 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:35.227720 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d632ee40-765b-4e66-8b2a-17420d65f923 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:35.228355 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d632ee40-765b-4e66-8b2a-17420d65f923 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:35.229372 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d632ee40-765b-4e66-8b2a-17420d65f923 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:35.263650 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b45a5456-dc6b-4eab-9d80-0a9c4f9bd1be tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:35.274530 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b45a5456-dc6b-4eab-9d80-0a9c4f9bd1be tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.299791 Aug 29 19:09:35.275143 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 155/302] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:34 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:35.408151 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d632ee40-765b-4e66-8b2a-17420d65f923 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:35.417160 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d632ee40-765b-4e66-8b2a-17420d65f923 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1319 microversion: 2.1 time: 0.207123 Aug 29 19:09:35.417713 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 148/303] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:35 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:36.231604 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:36.233884 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] [instance: 932ea63e-1e18-489e-b007-cba85d8ab0cf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:36.241252 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:36.242264 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:36.244601 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:36.245610 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:36.246316 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:36.247592 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:36.276708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:36.278581 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] HTTP exception thrown: Instance 932ea63e-1e18-489e-b007-cba85d8ab0cf could not be found. Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Request method failure captured: Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf HTTP/1.1 Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ7ZnhVN-7cVN97h1v35K10YHQVPHrdm7VcuvkijQVWaxBPovmjvBB7ijyteQMyvSmhsx2UU-6JDQgt7XzhEvtysDVfM3e-S7NFbA62SnJDA8M6DcwkU64TqkVoQTbnJ7GrBPH-xhax3285nbkXlTZIek9Y1XJw8jXMDF2MR2S473Zo Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 0f594096296743c583bf3f8e0c1f5110 Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-VolumesNegativeTest-1653966099 Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:09:36.280682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/0f594096296743c583bf3f8e0c1f5110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_0f594096296743c583bf3f8e0c1f5110"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/0f594096296743c583bf3f8e0c1f5110"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/0f594096296743c583bf3f8e0c1f5110"}]}] Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-VolumesNegativeTest-1653966099 Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 0f594096296743c583bf3f8e0c1f5110 Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-VolumesNegativeTest-1653966099 Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-VolumesNegativeTest-1653966099-project Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 4c27047dbc2c40de89017865e41a0dc6 Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-VolumesNegativeTest-1653966099-project Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 932ea63e-1e18-489e-b007-cba85d8ab0cf could not be found. Aug 29 19:09:36.282349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '932ea63e-1e18-489e-b007-cba85d8ab0cf'} Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 932ea63e-1e18-489e-b007-cba85d8ab0cf could not be found. Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:09:36.283370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 932ea63e-1e18-489e-b007-cba85d8ab0cf could not be found. Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 932ea63e-1e18-489e-b007-cba85d8ab0cf could not be found. Aug 29 19:09:36.284775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:09:36.286043 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] Returning 404 to user: Instance 932ea63e-1e18-489e-b007-cba85d8ab0cf could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:09:36.286043 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8c5cf4ab-f2e1-41c6-84e4-e071f31805ae tempest-VolumesNegativeTest-1653966099 tempest-VolumesNegativeTest-1653966099-project] 10.222.0.94 "GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf" status: 404 len: 111 microversion: 2.1 time: 0.055665 Aug 29 19:09:36.286043 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 156/304] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:36 2022] GET /compute/v2.1/servers/932ea63e-1e18-489e-b007-cba85d8ab0cf => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:09:36.298669 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-057e97dc-4cae-4161-a4fc-c502f69fce9f req-9f39f1cc-b7c7-480a-96bb-4bb0b0e5f028 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37f271b-60ea-41f7-86d3-9a324c423afb", "tag": "e8a3642c-273b-4ca2-98ac-e5056521d7a5"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:36.318918 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bc17a8af-a99c-4efe-aa52-eef55fb6d47a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:36.324792 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bc17a8af-a99c-4efe-aa52-eef55fb6d47a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:36.327228 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-057e97dc-4cae-4161-a4fc-c502f69fce9f req-9f39f1cc-b7c7-480a-96bb-4bb0b0e5f028 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:36.327712 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-057e97dc-4cae-4161-a4fc-c502f69fce9f req-9f39f1cc-b7c7-480a-96bb-4bb0b0e5f028 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:36.328144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-057e97dc-4cae-4161-a4fc-c502f69fce9f req-9f39f1cc-b7c7-480a-96bb-4bb0b0e5f028 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:36.336084 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc17a8af-a99c-4efe-aa52-eef55fb6d47a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:36.338465 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc17a8af-a99c-4efe-aa52-eef55fb6d47a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:36.339561 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc17a8af-a99c-4efe-aa52-eef55fb6d47a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:36.340488 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc17a8af-a99c-4efe-aa52-eef55fb6d47a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:36.341171 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc17a8af-a99c-4efe-aa52-eef55fb6d47a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:36.342165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc17a8af-a99c-4efe-aa52-eef55fb6d47a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:36.355649 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-057e97dc-4cae-4161-a4fc-c502f69fce9f req-9f39f1cc-b7c7-480a-96bb-4bb0b0e5f028 service nova] Creating event network-changed:e8a3642c-273b-4ca2-98ac-e5056521d7a5 for instance b37f271b-60ea-41f7-86d3-9a324c423afb on hv-cinder-73126 Aug 29 19:09:36.363046 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-057e97dc-4cae-4161-a4fc-c502f69fce9f req-9f39f1cc-b7c7-480a-96bb-4bb0b0e5f028 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072263 Aug 29 19:09:36.364108 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 149/305] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:36.441322 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b8425f91-8a36-476c-af04-cdd15f3cb096 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:36.442772 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b8425f91-8a36-476c-af04-cdd15f3cb096 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:36.451677 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b8425f91-8a36-476c-af04-cdd15f3cb096 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:36.452550 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b8425f91-8a36-476c-af04-cdd15f3cb096 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:36.453055 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b8425f91-8a36-476c-af04-cdd15f3cb096 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:36.453964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b8425f91-8a36-476c-af04-cdd15f3cb096 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:36.454763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b8425f91-8a36-476c-af04-cdd15f3cb096 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:36.455436 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b8425f91-8a36-476c-af04-cdd15f3cb096 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:36.940938 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-bc17a8af-a99c-4efe-aa52-eef55fb6d47a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:36.953839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bc17a8af-a99c-4efe-aa52-eef55fb6d47a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.647366 Aug 29 19:09:36.954714 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 157/306] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:36 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:37.076316 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b8425f91-8a36-476c-af04-cdd15f3cb096 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:37.091840 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b8425f91-8a36-476c-af04-cdd15f3cb096 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1319 microversion: 2.1 time: 0.654486 Aug 29 19:09:37.109324 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 150/307] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:36 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1319 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:37.981040 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d9a3362d-e4ea-4499-b820-fde612e39f64 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:37.981893 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d9a3362d-e4ea-4499-b820-fde612e39f64 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:37.988222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d9a3362d-e4ea-4499-b820-fde612e39f64 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:37.988775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d9a3362d-e4ea-4499-b820-fde612e39f64 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:37.989285 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d9a3362d-e4ea-4499-b820-fde612e39f64 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:37.990166 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d9a3362d-e4ea-4499-b820-fde612e39f64 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:37.990828 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d9a3362d-e4ea-4499-b820-fde612e39f64 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:37.991485 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d9a3362d-e4ea-4499-b820-fde612e39f64 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:38.119784 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f052bee1-7fec-44e4-aab1-30a1a47be11a tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:38.121159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f052bee1-7fec-44e4-aab1-30a1a47be11a tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:38.127640 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f052bee1-7fec-44e4-aab1-30a1a47be11a tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:38.128363 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f052bee1-7fec-44e4-aab1-30a1a47be11a tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:38.128766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f052bee1-7fec-44e4-aab1-30a1a47be11a tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:38.129503 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f052bee1-7fec-44e4-aab1-30a1a47be11a tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:38.129958 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f052bee1-7fec-44e4-aab1-30a1a47be11a tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:38.130987 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f052bee1-7fec-44e4-aab1-30a1a47be11a tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:38.179376 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d9a3362d-e4ea-4499-b820-fde612e39f64 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:38.189602 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d9a3362d-e4ea-4499-b820-fde612e39f64 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.212479 Aug 29 19:09:38.191093 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 158/308] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:37 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:38.317521 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f052bee1-7fec-44e4-aab1-30a1a47be11a tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:38.325695 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f052bee1-7fec-44e4-aab1-30a1a47be11a tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1319 microversion: 2.1 time: 0.211123 Aug 29 19:09:38.326554 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 151/309] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:38 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:39.215900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8e0ac5c2-e843-4cdd-a84f-20a186475066 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:39.216799 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8e0ac5c2-e843-4cdd-a84f-20a186475066 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:39.227278 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8e0ac5c2-e843-4cdd-a84f-20a186475066 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:39.233394 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8e0ac5c2-e843-4cdd-a84f-20a186475066 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:39.234022 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8e0ac5c2-e843-4cdd-a84f-20a186475066 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:39.243393 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8e0ac5c2-e843-4cdd-a84f-20a186475066 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:39.243393 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8e0ac5c2-e843-4cdd-a84f-20a186475066 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:39.243393 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8e0ac5c2-e843-4cdd-a84f-20a186475066 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:39.349090 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-89f8438f-ad66-4f46-b35f-e7c78d3cea09 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:39.349852 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-89f8438f-ad66-4f46-b35f-e7c78d3cea09 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:39.383471 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89f8438f-ad66-4f46-b35f-e7c78d3cea09 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:39.383988 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89f8438f-ad66-4f46-b35f-e7c78d3cea09 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:39.384432 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89f8438f-ad66-4f46-b35f-e7c78d3cea09 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:39.385143 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89f8438f-ad66-4f46-b35f-e7c78d3cea09 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:39.385637 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89f8438f-ad66-4f46-b35f-e7c78d3cea09 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:39.386018 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89f8438f-ad66-4f46-b35f-e7c78d3cea09 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:39.554495 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8e0ac5c2-e843-4cdd-a84f-20a186475066 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:39.581599 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8e0ac5c2-e843-4cdd-a84f-20a186475066 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.371324 Aug 29 19:09:39.609351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 159/310] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:39 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:39.748427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-89f8438f-ad66-4f46-b35f-e7c78d3cea09 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:39.768483 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-89f8438f-ad66-4f46-b35f-e7c78d3cea09 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1319 microversion: 2.1 time: 0.421328 Aug 29 19:09:39.769712 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 152/311] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:39 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1319 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:40.610803 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-463a2367-d697-46e5-93e1-9214fba2c857 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:40.612471 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-463a2367-d697-46e5-93e1-9214fba2c857 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:40.614349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:40.615659 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=6 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:40.623863 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-463a2367-d697-46e5-93e1-9214fba2c857 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:40.624394 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-463a2367-d697-46e5-93e1-9214fba2c857 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:40.624840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-463a2367-d697-46e5-93e1-9214fba2c857 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:40.625554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-463a2367-d697-46e5-93e1-9214fba2c857 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:40.626013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-463a2367-d697-46e5-93e1-9214fba2c857 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:40.626623 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-463a2367-d697-46e5-93e1-9214fba2c857 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:40.791016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-cf46ce5a-bf72-427c-8199-1cedcb1aeb80 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:40.792501 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-cf46ce5a-bf72-427c-8199-1cedcb1aeb80 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:40.797821 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:40.800767 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cf46ce5a-bf72-427c-8199-1cedcb1aeb80 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:40.801545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cf46ce5a-bf72-427c-8199-1cedcb1aeb80 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:40.802616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cf46ce5a-bf72-427c-8199-1cedcb1aeb80 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:40.803639 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cf46ce5a-bf72-427c-8199-1cedcb1aeb80 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:40.804302 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cf46ce5a-bf72-427c-8199-1cedcb1aeb80 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:40.804906 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cf46ce5a-bf72-427c-8199-1cedcb1aeb80 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:40.906194 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-463a2367-d697-46e5-93e1-9214fba2c857 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:40.915798 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-463a2367-d697-46e5-93e1-9214fba2c857 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.308917 Aug 29 19:09:40.917577 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 160/312] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:40 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:41.069174 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-cf46ce5a-bf72-427c-8199-1cedcb1aeb80 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:41.083876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-cf46ce5a-bf72-427c-8199-1cedcb1aeb80 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1319 microversion: 2.1 time: 0.297023 Aug 29 19:09:41.099226 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 153/313] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:40 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:41.938364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bad1519b-52eb-43d5-88e7-96881fa3a6a8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:41.939009 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bad1519b-52eb-43d5-88e7-96881fa3a6a8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:41.946491 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bad1519b-52eb-43d5-88e7-96881fa3a6a8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:41.946985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bad1519b-52eb-43d5-88e7-96881fa3a6a8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:41.947476 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bad1519b-52eb-43d5-88e7-96881fa3a6a8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:41.948182 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bad1519b-52eb-43d5-88e7-96881fa3a6a8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:41.948646 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bad1519b-52eb-43d5-88e7-96881fa3a6a8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:41.949075 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bad1519b-52eb-43d5-88e7-96881fa3a6a8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:41.980946 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-29625a8c-51ed-4b3a-88c6-c115c83d023c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:41.981514 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-29625a8c-51ed-4b3a-88c6-c115c83d023c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:41.988920 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29625a8c-51ed-4b3a-88c6-c115c83d023c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:41.989580 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29625a8c-51ed-4b3a-88c6-c115c83d023c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:41.990089 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29625a8c-51ed-4b3a-88c6-c115c83d023c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:41.991266 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29625a8c-51ed-4b3a-88c6-c115c83d023c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:41.991799 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29625a8c-51ed-4b3a-88c6-c115c83d023c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:41.992515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29625a8c-51ed-4b3a-88c6-c115c83d023c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:42.022046 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-29625a8c-51ed-4b3a-88c6-c115c83d023c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/ips" status: 200 len: 146 microversion: 2.1 time: 0.046192 Aug 29 19:09:42.022858 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 154/314] 10.222.0.94 () {58 vars in 1248 bytes} [Mon Aug 29 19:09:41 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:09:42.106930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-24929645-d652-4357-bd8f-57099ee690a7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:42.108049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-24929645-d652-4357-bd8f-57099ee690a7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:42.115925 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24929645-d652-4357-bd8f-57099ee690a7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:42.116960 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24929645-d652-4357-bd8f-57099ee690a7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:42.118759 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24929645-d652-4357-bd8f-57099ee690a7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:42.120547 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24929645-d652-4357-bd8f-57099ee690a7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:42.120702 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24929645-d652-4357-bd8f-57099ee690a7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:42.121082 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24929645-d652-4357-bd8f-57099ee690a7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:42.275790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-bad1519b-52eb-43d5-88e7-96881fa3a6a8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:42.293037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bad1519b-52eb-43d5-88e7-96881fa3a6a8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.354075 Aug 29 19:09:42.294325 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 161/315] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:41 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:42.392592 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-24929645-d652-4357-bd8f-57099ee690a7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:42.396185 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:42.402768 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-24929645-d652-4357-bd8f-57099ee690a7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1319 microversion: 2.1 time: 0.299952 Aug 29 19:09:42.408367 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 155/316] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:42 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:43.315520 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-636cd2ed-50dc-4add-bc9e-77ab8216d662 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:43.316131 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-636cd2ed-50dc-4add-bc9e-77ab8216d662 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:43.323616 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-636cd2ed-50dc-4add-bc9e-77ab8216d662 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:43.324347 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-636cd2ed-50dc-4add-bc9e-77ab8216d662 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:43.324946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-636cd2ed-50dc-4add-bc9e-77ab8216d662 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:43.325811 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-636cd2ed-50dc-4add-bc9e-77ab8216d662 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:43.326447 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-636cd2ed-50dc-4add-bc9e-77ab8216d662 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:43.327047 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-636cd2ed-50dc-4add-bc9e-77ab8216d662 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:43.447492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-180c95e6-f250-4ed6-bf9b-13f915a73f49 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:43.449969 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-180c95e6-f250-4ed6-bf9b-13f915a73f49 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:43.494543 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-180c95e6-f250-4ed6-bf9b-13f915a73f49 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:43.495155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-180c95e6-f250-4ed6-bf9b-13f915a73f49 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:43.495646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-180c95e6-f250-4ed6-bf9b-13f915a73f49 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:43.496465 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-180c95e6-f250-4ed6-bf9b-13f915a73f49 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:43.496847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-180c95e6-f250-4ed6-bf9b-13f915a73f49 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:43.497387 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-180c95e6-f250-4ed6-bf9b-13f915a73f49 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:43.573960 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-636cd2ed-50dc-4add-bc9e-77ab8216d662 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:43.582630 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-636cd2ed-50dc-4add-bc9e-77ab8216d662 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.271073 Aug 29 19:09:43.583683 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 162/317] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:43 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:43.727769 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-180c95e6-f250-4ed6-bf9b-13f915a73f49 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:43.736333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-180c95e6-f250-4ed6-bf9b-13f915a73f49 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1319 microversion: 2.1 time: 0.307280 Aug 29 19:09:43.737044 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 156/318] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:43 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:44.459046 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-e104a63e-cf89-4b38-95cf-9c062cdfc568 req-f2a6ebb9-62d9-44a1-8b51-fa60bf3005ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37f271b-60ea-41f7-86d3-9a324c423afb", "name": "network-vif-plugged", "status": "completed", "tag": "e8a3642c-273b-4ca2-98ac-e5056521d7a5"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:44.492221 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-e104a63e-cf89-4b38-95cf-9c062cdfc568 req-f2a6ebb9-62d9-44a1-8b51-fa60bf3005ef service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:44.493803 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-e104a63e-cf89-4b38-95cf-9c062cdfc568 req-f2a6ebb9-62d9-44a1-8b51-fa60bf3005ef service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:44.500484 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-e104a63e-cf89-4b38-95cf-9c062cdfc568 req-f2a6ebb9-62d9-44a1-8b51-fa60bf3005ef service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:44.538837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-e104a63e-cf89-4b38-95cf-9c062cdfc568 req-f2a6ebb9-62d9-44a1-8b51-fa60bf3005ef service nova] Creating event network-vif-plugged:e8a3642c-273b-4ca2-98ac-e5056521d7a5 for instance b37f271b-60ea-41f7-86d3-9a324c423afb on hv-cinder-73126 Aug 29 19:09:44.562254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-e104a63e-cf89-4b38-95cf-9c062cdfc568 req-f2a6ebb9-62d9-44a1-8b51-fa60bf3005ef service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108703 Aug 29 19:09:44.563988 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 163/319] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:44.604709 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-03107799-82fe-40a9-8552-904cf201007e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:44.606352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-03107799-82fe-40a9-8552-904cf201007e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:44.615328 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03107799-82fe-40a9-8552-904cf201007e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:44.616792 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03107799-82fe-40a9-8552-904cf201007e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:44.618375 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03107799-82fe-40a9-8552-904cf201007e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:44.619305 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03107799-82fe-40a9-8552-904cf201007e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:44.620341 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03107799-82fe-40a9-8552-904cf201007e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:44.620960 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03107799-82fe-40a9-8552-904cf201007e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:44.760946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8f696940-06b5-452e-90bc-c13d3c71b1f7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:44.761968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8f696940-06b5-452e-90bc-c13d3c71b1f7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:44.774536 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f696940-06b5-452e-90bc-c13d3c71b1f7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:44.776599 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f696940-06b5-452e-90bc-c13d3c71b1f7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:44.777685 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f696940-06b5-452e-90bc-c13d3c71b1f7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:44.779003 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f696940-06b5-452e-90bc-c13d3c71b1f7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:44.780170 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f696940-06b5-452e-90bc-c13d3c71b1f7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:44.780772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f696940-06b5-452e-90bc-c13d3c71b1f7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:45.191890 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-03107799-82fe-40a9-8552-904cf201007e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:45.214901 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-03107799-82fe-40a9-8552-904cf201007e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1521 microversion: 2.1 time: 0.615017 Aug 29 19:09:45.215531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 157/320] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:44 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:45.285615 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8f696940-06b5-452e-90bc-c13d3c71b1f7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:45.298178 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8f696940-06b5-452e-90bc-c13d3c71b1f7 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1319 microversion: 2.1 time: 0.540723 Aug 29 19:09:45.298796 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 164/321] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:44 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:46.240149 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9d1260ca-c805-45dc-852e-8e6dd43a8ddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:46.240699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9d1260ca-c805-45dc-852e-8e6dd43a8ddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:46.255759 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d1260ca-c805-45dc-852e-8e6dd43a8ddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:46.257184 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d1260ca-c805-45dc-852e-8e6dd43a8ddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:46.257721 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d1260ca-c805-45dc-852e-8e6dd43a8ddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:46.260072 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d1260ca-c805-45dc-852e-8e6dd43a8ddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:46.261547 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d1260ca-c805-45dc-852e-8e6dd43a8ddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:46.261992 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d1260ca-c805-45dc-852e-8e6dd43a8ddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:46.358208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-827243cc-53f3-4297-bc57-9ffd0b42a014 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:46.358805 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-827243cc-53f3-4297-bc57-9ffd0b42a014 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:46.375134 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827243cc-53f3-4297-bc57-9ffd0b42a014 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:46.375636 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827243cc-53f3-4297-bc57-9ffd0b42a014 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:46.376611 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827243cc-53f3-4297-bc57-9ffd0b42a014 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:46.377320 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827243cc-53f3-4297-bc57-9ffd0b42a014 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:46.377773 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827243cc-53f3-4297-bc57-9ffd0b42a014 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:46.378196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827243cc-53f3-4297-bc57-9ffd0b42a014 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:46.801917 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9d1260ca-c805-45dc-852e-8e6dd43a8ddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:46.812869 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9d1260ca-c805-45dc-852e-8e6dd43a8ddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1501 microversion: 2.1 time: 0.576774 Aug 29 19:09:46.832544 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 158/322] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:46 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1501 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:46.852586 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c2a46b8b-b708-4a3a-a17a-feafbc2b74d8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e08e44c-474a-4b6a-9dfc-773f59a827ea"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:46.855349 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c2a46b8b-b708-4a3a-a17a-feafbc2b74d8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:46.871667 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2a46b8b-b708-4a3a-a17a-feafbc2b74d8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:46.872419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2a46b8b-b708-4a3a-a17a-feafbc2b74d8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:46.873047 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2a46b8b-b708-4a3a-a17a-feafbc2b74d8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:46.873923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2a46b8b-b708-4a3a-a17a-feafbc2b74d8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:46.874536 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2a46b8b-b708-4a3a-a17a-feafbc2b74d8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:46.875157 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c2a46b8b-b708-4a3a-a17a-feafbc2b74d8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:46.965567 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-827243cc-53f3-4297-bc57-9ffd0b42a014 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:46.977308 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-827243cc-53f3-4297-bc57-9ffd0b42a014 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1319 microversion: 2.1 time: 0.649440 Aug 29 19:09:46.978286 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 165/323] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:46 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1319 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:47.013595 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-702459d4-5341-4b52-9f6b-df9b2a17a0ce tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:47.014260 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-702459d4-5341-4b52-9f6b-df9b2a17a0ce tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:47.043909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-702459d4-5341-4b52-9f6b-df9b2a17a0ce tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:47.045177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-702459d4-5341-4b52-9f6b-df9b2a17a0ce tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:47.045627 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-702459d4-5341-4b52-9f6b-df9b2a17a0ce tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:47.046351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-702459d4-5341-4b52-9f6b-df9b2a17a0ce tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:47.046813 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-702459d4-5341-4b52-9f6b-df9b2a17a0ce tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:47.047272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-702459d4-5341-4b52-9f6b-df9b2a17a0ce tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:47.525919 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-702459d4-5341-4b52-9f6b-df9b2a17a0ce tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:47.540972 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-702459d4-5341-4b52-9f6b-df9b2a17a0ce tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1517 microversion: 2.1 time: 0.541854 Aug 29 19:09:47.541807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 166/324] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:46 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1517 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:47.999903 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f56fed52-fda0-4315-bd4d-f5df69ce966b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:48.000522 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f56fed52-fda0-4315-bd4d-f5df69ce966b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:48.013998 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f56fed52-fda0-4315-bd4d-f5df69ce966b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:48.014501 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f56fed52-fda0-4315-bd4d-f5df69ce966b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:48.014939 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f56fed52-fda0-4315-bd4d-f5df69ce966b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:48.015757 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f56fed52-fda0-4315-bd4d-f5df69ce966b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:48.024968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f56fed52-fda0-4315-bd4d-f5df69ce966b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:48.027391 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f56fed52-fda0-4315-bd4d-f5df69ce966b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:48.182009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c2a46b8b-b708-4a3a-a17a-feafbc2b74d8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "POST /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.347619 Aug 29 19:09:48.184899 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 159/325] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:09:46 2022] POST /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/os-volume_attachments => generated 194 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:48.541378 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f56fed52-fda0-4315-bd4d-f5df69ce966b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:48.554747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f56fed52-fda0-4315-bd4d-f5df69ce966b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1508 microversion: 2.1 time: 0.557018 Aug 29 19:09:48.577358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 167/326] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:47 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1508 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:49.787451 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ad046608-74cc-4fb5-ae58-fb7f29870053 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:49.800777 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ad046608-74cc-4fb5-ae58-fb7f29870053 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:49.823964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad046608-74cc-4fb5-ae58-fb7f29870053 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:49.832354 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad046608-74cc-4fb5-ae58-fb7f29870053 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:49.832987 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad046608-74cc-4fb5-ae58-fb7f29870053 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:49.833903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad046608-74cc-4fb5-ae58-fb7f29870053 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:49.834970 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad046608-74cc-4fb5-ae58-fb7f29870053 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:49.835602 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ad046608-74cc-4fb5-ae58-fb7f29870053 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:49.880097 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-ad046608-74cc-4fb5-ae58-fb7f29870053 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lazy-loading 'flavor' on Instance uuid b28b5c17-0afa-4fff-a814-653688b1231b {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:09:50.085215 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ad046608-74cc-4fb5-ae58-fb7f29870053 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "POST /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b/action" status: 200 len: 32 microversion: 2.1 time: 0.303678 Aug 29 19:09:50.089356 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 160/327] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:09:49 2022] POST /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b/action => generated 32 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:09:50.100015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e0963db8-40bf-4b48-b19f-77ff2bac844b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:50.102960 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e0963db8-40bf-4b48-b19f-77ff2bac844b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:50.121425 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0963db8-40bf-4b48-b19f-77ff2bac844b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:50.122216 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0963db8-40bf-4b48-b19f-77ff2bac844b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:50.122894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0963db8-40bf-4b48-b19f-77ff2bac844b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:50.123857 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0963db8-40bf-4b48-b19f-77ff2bac844b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:50.125931 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0963db8-40bf-4b48-b19f-77ff2bac844b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:50.128849 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0963db8-40bf-4b48-b19f-77ff2bac844b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:50.524694 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8e7f1d74-23f7-4456-9972-cabb1e415ea1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Action: 'create', calling method: .version_select at 0x7f3d765dec10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1804926399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAh5byJ8iRkiOab/sxE/Q/4priLOXoMxc7QyMGjDsDa5TZH49MxGMcWBSDxErAUyzwIQIWe/MaRE84tcGurqV2Dey+Vo/HSw/VnSl+VGABF8P3swqRAgyj5c27Gedal2AA=="}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:50.581779 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-8e7f1d74-23f7-4456-9972-cabb1e415ea1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Getting quotas for project 6a4d940594f542808602c7260993f85f. Resources: {'key_pairs'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:09:50.589462 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-8e7f1d74-23f7-4456-9972-cabb1e415ea1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Getting quotas for user 8f1c0b2189a041fdb8dbe2a0290ffac8 and project 6a4d940594f542808602c7260993f85f. Resources: {'key_pairs'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:09:50.681740 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8e7f1d74-23f7-4456-9972-cabb1e415ea1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.769314 Aug 29 19:09:50.683588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 168/328] 10.222.0.94 () {60 vars in 1159 bytes} [Mon Aug 29 19:09:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:50.904429 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e0963db8-40bf-4b48-b19f-77ff2bac844b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:50.918846 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e0963db8-40bf-4b48-b19f-77ff2bac844b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.823244 Aug 29 19:09:50.934889 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 161/329] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:50 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:51.942586 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-28fe3ab0-c41c-4633-8043-c294b17458f0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:51.943743 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-28fe3ab0-c41c-4633-8043-c294b17458f0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:51.957103 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-28fe3ab0-c41c-4633-8043-c294b17458f0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:51.959093 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-28fe3ab0-c41c-4633-8043-c294b17458f0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:51.963280 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-28fe3ab0-c41c-4633-8043-c294b17458f0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:51.964734 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-28fe3ab0-c41c-4633-8043-c294b17458f0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:51.965419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-28fe3ab0-c41c-4633-8043-c294b17458f0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:51.966087 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-28fe3ab0-c41c-4633-8043-c294b17458f0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:52.326827 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-28fe3ab0-c41c-4633-8043-c294b17458f0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:52.334761 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-28fe3ab0-c41c-4633-8043-c294b17458f0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.396392 Aug 29 19:09:52.335384 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 169/330] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:51 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:53.332321 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a1508435-3080-44f2-98fc-6dd83a233ade tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:53.332966 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a1508435-3080-44f2-98fc-6dd83a233ade tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:53.348161 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1508435-3080-44f2-98fc-6dd83a233ade tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:53.348725 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1508435-3080-44f2-98fc-6dd83a233ade tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:53.354487 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1508435-3080-44f2-98fc-6dd83a233ade tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:53.355408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1508435-3080-44f2-98fc-6dd83a233ade tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:53.359964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0da23f57-3d98-4681-90c3-2996915f3f5c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:53.360755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1508435-3080-44f2-98fc-6dd83a233ade tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:53.361453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0da23f57-3d98-4681-90c3-2996915f3f5c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:53.362469 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1508435-3080-44f2-98fc-6dd83a233ade tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:53.371231 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da23f57-3d98-4681-90c3-2996915f3f5c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:53.373542 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da23f57-3d98-4681-90c3-2996915f3f5c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:53.374319 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da23f57-3d98-4681-90c3-2996915f3f5c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:53.375363 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da23f57-3d98-4681-90c3-2996915f3f5c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:53.378630 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da23f57-3d98-4681-90c3-2996915f3f5c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:53.379569 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da23f57-3d98-4681-90c3-2996915f3f5c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:53.457090 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a1508435-3080-44f2-98fc-6dd83a233ade tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/ips" status: 200 len: 151 microversion: 2.20 time: 0.129948 Aug 29 19:09:53.458611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 162/331] 10.222.0.94 () {60 vars in 1289 bytes} [Mon Aug 29 19:09:53 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/ips => generated 151 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:09:53.807683 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0da23f57-3d98-4681-90c3-2996915f3f5c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:53.820557 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0da23f57-3d98-4681-90c3-2996915f3f5c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.464709 Aug 29 19:09:53.823688 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 170/332] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:53 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:09:54.846354 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5bf1d2ad-9d3d-4657-97ea-d8d2bf09aa1a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:54.846970 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5bf1d2ad-9d3d-4657-97ea-d8d2bf09aa1a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:54.855971 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bf1d2ad-9d3d-4657-97ea-d8d2bf09aa1a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:54.856462 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bf1d2ad-9d3d-4657-97ea-d8d2bf09aa1a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:54.856895 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bf1d2ad-9d3d-4657-97ea-d8d2bf09aa1a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:54.857594 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bf1d2ad-9d3d-4657-97ea-d8d2bf09aa1a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:54.863724 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bf1d2ad-9d3d-4657-97ea-d8d2bf09aa1a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:54.864749 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bf1d2ad-9d3d-4657-97ea-d8d2bf09aa1a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:55.139370 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5bf1d2ad-9d3d-4657-97ea-d8d2bf09aa1a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:55.149435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5bf1d2ad-9d3d-4657-97ea-d8d2bf09aa1a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.306917 Aug 29 19:09:55.151221 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 163/333] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:54 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:55.177891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-91801b4b-9012-4cd0-9166-41052e6340a9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:55.179287 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-91801b4b-9012-4cd0-9166-41052e6340a9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:55.190309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91801b4b-9012-4cd0-9166-41052e6340a9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:55.190909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91801b4b-9012-4cd0-9166-41052e6340a9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:55.191535 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91801b4b-9012-4cd0-9166-41052e6340a9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:55.192313 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91801b4b-9012-4cd0-9166-41052e6340a9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:55.192827 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91801b4b-9012-4cd0-9166-41052e6340a9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:55.193313 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91801b4b-9012-4cd0-9166-41052e6340a9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:55.239356 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-91801b4b-9012-4cd0-9166-41052e6340a9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/ips" status: 200 len: 151 microversion: 2.1 time: 0.065798 Aug 29 19:09:55.246583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 171/334] 10.222.0.94 () {58 vars in 1248 bytes} [Mon Aug 29 19:09:55 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/ips => generated 151 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:09:56.178348 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-4c07695d-6970-4d44-9bf3-090fbd05a539 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:56.181405 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-4c07695d-6970-4d44-9bf3-090fbd05a539 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:56.196586 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4c07695d-6970-4d44-9bf3-090fbd05a539 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:56.197965 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4c07695d-6970-4d44-9bf3-090fbd05a539 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:56.198675 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4c07695d-6970-4d44-9bf3-090fbd05a539 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:56.200161 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4c07695d-6970-4d44-9bf3-090fbd05a539 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:56.200809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4c07695d-6970-4d44-9bf3-090fbd05a539 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:56.208051 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4c07695d-6970-4d44-9bf3-090fbd05a539 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:56.495464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4c07695d-6970-4d44-9bf3-090fbd05a539 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:56.504985 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-4c07695d-6970-4d44-9bf3-090fbd05a539 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.334883 Aug 29 19:09:56.521863 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 164/335] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:56 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:56.823229 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5b457d5c-2990-4f9f-97e3-40ead6b92b56 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:56.823777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5b457d5c-2990-4f9f-97e3-40ead6b92b56 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:56.833930 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5b457d5c-2990-4f9f-97e3-40ead6b92b56 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:56.834426 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5b457d5c-2990-4f9f-97e3-40ead6b92b56 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:56.834964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5b457d5c-2990-4f9f-97e3-40ead6b92b56 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:56.837162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5b457d5c-2990-4f9f-97e3-40ead6b92b56 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:56.837631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5b457d5c-2990-4f9f-97e3-40ead6b92b56 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:56.838052 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5b457d5c-2990-4f9f-97e3-40ead6b92b56 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:56.865230 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-5b457d5c-2990-4f9f-97e3-40ead6b92b56 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lazy-loading 'flavor' on Instance uuid 4696f764-f3e7-482f-b94e-549896198ddf {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:09:57.101244 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-67b896b5-15bb-4dd8-bdde-60fcea2e083e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4572b37-e415-4786-b0cc-e8bb98a3c83e"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:57.106301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-67b896b5-15bb-4dd8-bdde-60fcea2e083e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:57.125353 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67b896b5-15bb-4dd8-bdde-60fcea2e083e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:57.126783 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67b896b5-15bb-4dd8-bdde-60fcea2e083e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:57.128222 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67b896b5-15bb-4dd8-bdde-60fcea2e083e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:57.129347 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67b896b5-15bb-4dd8-bdde-60fcea2e083e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:57.130311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67b896b5-15bb-4dd8-bdde-60fcea2e083e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:57.130969 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67b896b5-15bb-4dd8-bdde-60fcea2e083e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:57.600801 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-67b896b5-15bb-4dd8-bdde-60fcea2e083e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.505445 Aug 29 19:09:57.603536 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 165/336] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:09:57 2022] POST /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:09:57.632246 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-4f8ade7f-7b68-43de-9dfb-20afbe0815e4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:09:57.658875 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4f8ade7f-7b68-43de-9dfb-20afbe0815e4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:57.660413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4f8ade7f-7b68-43de-9dfb-20afbe0815e4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:57.661742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4f8ade7f-7b68-43de-9dfb-20afbe0815e4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:57.828477 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-4f8ade7f-7b68-43de-9dfb-20afbe0815e4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Going to try to stop instance {{(pid=115968) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 19:09:57.900611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-4f8ade7f-7b68-43de-9dfb-20afbe0815e4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "POST /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/action" status: 202 len: 0 microversion: 2.1 time: 0.293470 Aug 29 19:09:57.904296 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 166/337] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:09:57 2022] POST /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:09:57.914888 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-89c19f49-0c59-4bfe-86f5-12e20ac2c6d0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:57.918230 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-89c19f49-0c59-4bfe-86f5-12e20ac2c6d0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:57.940983 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89c19f49-0c59-4bfe-86f5-12e20ac2c6d0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:57.941541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89c19f49-0c59-4bfe-86f5-12e20ac2c6d0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:57.945607 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89c19f49-0c59-4bfe-86f5-12e20ac2c6d0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:57.948915 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89c19f49-0c59-4bfe-86f5-12e20ac2c6d0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:57.949657 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89c19f49-0c59-4bfe-86f5-12e20ac2c6d0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:57.950357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89c19f49-0c59-4bfe-86f5-12e20ac2c6d0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:57.989258 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:09:58.274598 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-89c19f49-0c59-4bfe-86f5-12e20ac2c6d0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:58.286401 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-89c19f49-0c59-4bfe-86f5-12e20ac2c6d0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.380822 Aug 29 19:09:58.288879 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 167/338] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:57 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:58.296210 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-09695bd5-bb06-4468-9e78-a296fb6e92b3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:58.297941 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-09695bd5-bb06-4468-9e78-a296fb6e92b3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:58.325316 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-09695bd5-bb06-4468-9e78-a296fb6e92b3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:58.329690 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-09695bd5-bb06-4468-9e78-a296fb6e92b3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:58.330433 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-09695bd5-bb06-4468-9e78-a296fb6e92b3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:58.333639 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-09695bd5-bb06-4468-9e78-a296fb6e92b3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:58.335128 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-09695bd5-bb06-4468-9e78-a296fb6e92b3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:58.335707 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-09695bd5-bb06-4468-9e78-a296fb6e92b3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:58.577365 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-09695bd5-bb06-4468-9e78-a296fb6e92b3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:09:58.590770 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-09695bd5-bb06-4468-9e78-a296fb6e92b3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.300351 Aug 29 19:09:58.591498 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 168/339] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:58 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:09:59.311223 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-cbd09475-9bba-4289-a10b-80cc0fb14484 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:09:59.311889 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-cbd09475-9bba-4289-a10b-80cc0fb14484 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:09:59.324437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cbd09475-9bba-4289-a10b-80cc0fb14484 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:59.325008 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cbd09475-9bba-4289-a10b-80cc0fb14484 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:59.325451 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cbd09475-9bba-4289-a10b-80cc0fb14484 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:09:59.326167 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cbd09475-9bba-4289-a10b-80cc0fb14484 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:09:59.326619 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cbd09475-9bba-4289-a10b-80cc0fb14484 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:09:59.327037 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cbd09475-9bba-4289-a10b-80cc0fb14484 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:00.269383 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-cbd09475-9bba-4289-a10b-80cc0fb14484 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:00.280768 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-cbd09475-9bba-4289-a10b-80cc0fb14484 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.975661 Aug 29 19:10:00.301288 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 169/340] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:09:59 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:00.308757 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7415f618-08a3-4838-b75a-e6d4f227f109 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:00.309676 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7415f618-08a3-4838-b75a-e6d4f227f109 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:00.311855 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=68 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:00.345120 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7415f618-08a3-4838-b75a-e6d4f227f109 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:00.345623 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7415f618-08a3-4838-b75a-e6d4f227f109 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:00.346061 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7415f618-08a3-4838-b75a-e6d4f227f109 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:00.362775 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7415f618-08a3-4838-b75a-e6d4f227f109 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:00.363637 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7415f618-08a3-4838-b75a-e6d4f227f109 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:00.364238 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7415f618-08a3-4838-b75a-e6d4f227f109 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:00.606236 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=4 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:00.669833 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7415f618-08a3-4838-b75a-e6d4f227f109 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:00.694949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7415f618-08a3-4838-b75a-e6d4f227f109 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.392241 Aug 29 19:10:00.696073 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 170/341] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:00 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:01.326647 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c82e3150-1d21-404d-b34a-41396b1e1bdd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:01.329805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c82e3150-1d21-404d-b34a-41396b1e1bdd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:01.337940 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c82e3150-1d21-404d-b34a-41396b1e1bdd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:01.338443 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c82e3150-1d21-404d-b34a-41396b1e1bdd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:01.339088 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c82e3150-1d21-404d-b34a-41396b1e1bdd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:01.340113 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c82e3150-1d21-404d-b34a-41396b1e1bdd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:01.340606 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c82e3150-1d21-404d-b34a-41396b1e1bdd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:01.341013 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c82e3150-1d21-404d-b34a-41396b1e1bdd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:01.679818 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c82e3150-1d21-404d-b34a-41396b1e1bdd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:01.692924 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c82e3150-1d21-404d-b34a-41396b1e1bdd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.374184 Aug 29 19:10:01.694249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 171/342] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:01 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:01.717231 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-02e7f4d4-1772-4d7d-a8e4-44e6248cf905 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:01.718062 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-02e7f4d4-1772-4d7d-a8e4-44e6248cf905 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:01.728830 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02e7f4d4-1772-4d7d-a8e4-44e6248cf905 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:01.733284 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02e7f4d4-1772-4d7d-a8e4-44e6248cf905 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:01.733849 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02e7f4d4-1772-4d7d-a8e4-44e6248cf905 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:01.734610 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02e7f4d4-1772-4d7d-a8e4-44e6248cf905 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:01.735173 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02e7f4d4-1772-4d7d-a8e4-44e6248cf905 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:01.735610 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-02e7f4d4-1772-4d7d-a8e4-44e6248cf905 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:01.985509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-02e7f4d4-1772-4d7d-a8e4-44e6248cf905 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:01.995196 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-02e7f4d4-1772-4d7d-a8e4-44e6248cf905 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.282153 Aug 29 19:10:01.996113 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 172/343] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:01 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:02.720812 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9f10ee01-7814-4e96-bf21-38ea3b57e12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:02.721482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9f10ee01-7814-4e96-bf21-38ea3b57e12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:02.729035 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f10ee01-7814-4e96-bf21-38ea3b57e12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:02.729535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f10ee01-7814-4e96-bf21-38ea3b57e12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:02.730180 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f10ee01-7814-4e96-bf21-38ea3b57e12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:02.731163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f10ee01-7814-4e96-bf21-38ea3b57e12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:02.731560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f10ee01-7814-4e96-bf21-38ea3b57e12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:02.732157 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f10ee01-7814-4e96-bf21-38ea3b57e12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:02.923236 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9f10ee01-7814-4e96-bf21-38ea3b57e12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:02.932235 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9f10ee01-7814-4e96-bf21-38ea3b57e12c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.220680 Aug 29 19:10:02.945954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 173/344] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:02 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:03.020654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-429b508b-8332-4a95-a981-b8d6b5df7caf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:03.021280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-429b508b-8332-4a95-a981-b8d6b5df7caf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:03.035607 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-429b508b-8332-4a95-a981-b8d6b5df7caf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:03.036113 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-429b508b-8332-4a95-a981-b8d6b5df7caf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:03.036547 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-429b508b-8332-4a95-a981-b8d6b5df7caf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:03.042842 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-429b508b-8332-4a95-a981-b8d6b5df7caf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:03.044070 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-429b508b-8332-4a95-a981-b8d6b5df7caf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:03.045389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-429b508b-8332-4a95-a981-b8d6b5df7caf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:03.228595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-429b508b-8332-4a95-a981-b8d6b5df7caf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:03.238001 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-429b508b-8332-4a95-a981-b8d6b5df7caf tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.221986 Aug 29 19:10:03.253899 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 174/345] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:03 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:03.953539 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-16274d6f-d05e-42f0-a600-368606d82acb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:03.954796 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-16274d6f-d05e-42f0-a600-368606d82acb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:03.967026 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16274d6f-d05e-42f0-a600-368606d82acb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:03.967802 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16274d6f-d05e-42f0-a600-368606d82acb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:03.968419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16274d6f-d05e-42f0-a600-368606d82acb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:03.969135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16274d6f-d05e-42f0-a600-368606d82acb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:03.969595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16274d6f-d05e-42f0-a600-368606d82acb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:03.970021 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16274d6f-d05e-42f0-a600-368606d82acb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:04.157763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-16274d6f-d05e-42f0-a600-368606d82acb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:04.171491 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-16274d6f-d05e-42f0-a600-368606d82acb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.222118 Aug 29 19:10:04.172164 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 175/346] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:03 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:04.393844 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1237a876-9826-463d-8895-59f8d0366f19 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Action: 'create', calling method: .version_select at 0x7f3d76489c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1218624179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrHTbrjfpmLP3qE5Ca+MR6tCMppSc/1Z9XI20ciMMVr14Btxu1N60yKejklaQOB5PGFJZp3hZ8qUzABi4AydsWZcxPMishrQAk6OIte6s1ditAOc3c23hGJvPzzr9Rp7w=="}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:04.412446 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-1237a876-9826-463d-8895-59f8d0366f19 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Getting quotas for project f0f4bcf841c942a9928f5b343b5fb8bb. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:10:04.424724 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-1237a876-9826-463d-8895-59f8d0366f19 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Getting quotas for user 82fb5d585b5d460bb258f929057a4093 and project f0f4bcf841c942a9928f5b343b5fb8bb. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:10:04.473395 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1237a876-9826-463d-8895-59f8d0366f19 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.287946 Aug 29 19:10:04.474307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 176/347] 10.222.0.94 () {60 vars in 1159 bytes} [Mon Aug 29 19:10:04 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:04.483274 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f0711da2-735e-43b9-8da7-eabbdd743a0d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:04.483799 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f0711da2-735e-43b9-8da7-eabbdd743a0d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:04.491787 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f0711da2-735e-43b9-8da7-eabbdd743a0d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:04.493136 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f0711da2-735e-43b9-8da7-eabbdd743a0d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:04.493496 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f0711da2-735e-43b9-8da7-eabbdd743a0d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:04.494689 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f0711da2-735e-43b9-8da7-eabbdd743a0d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:04.497811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f0711da2-735e-43b9-8da7-eabbdd743a0d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:04.498512 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f0711da2-735e-43b9-8da7-eabbdd743a0d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:04.713975 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f0711da2-735e-43b9-8da7-eabbdd743a0d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:04.724711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f0711da2-735e-43b9-8da7-eabbdd743a0d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.248638 Aug 29 19:10:04.725587 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 177/348] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:04 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:05.194757 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-289b0bda-1d44-4d38-91a7-d09101cc91ad tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:05.196895 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-289b0bda-1d44-4d38-91a7-d09101cc91ad tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:05.204099 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-289b0bda-1d44-4d38-91a7-d09101cc91ad tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:05.205027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-289b0bda-1d44-4d38-91a7-d09101cc91ad tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:05.206440 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-289b0bda-1d44-4d38-91a7-d09101cc91ad tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:05.207941 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-289b0bda-1d44-4d38-91a7-d09101cc91ad tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:05.208566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-289b0bda-1d44-4d38-91a7-d09101cc91ad tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:05.209157 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-289b0bda-1d44-4d38-91a7-d09101cc91ad tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:05.554261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-289b0bda-1d44-4d38-91a7-d09101cc91ad tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:05.570942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-289b0bda-1d44-4d38-91a7-d09101cc91ad tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.380361 Aug 29 19:10:05.573013 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 178/349] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:05 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:05.583759 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d7a79f87-7057-42a8-830f-a8955881ad6c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: .version_select at 0x7f3d7655c8b0>, body: {"keypair": {"name": "tempest-keypair-1470411950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdkepzkeUmVrmBZ03nUWLl+xHVl9pKQ+KoersA7YgXbL7e2QyvR2WQ6Kb4MLl720K6+w1oNqdqaCVif25gqwAGhtynstdyhsQsKBISZ1Qt5GompRwl5pRa5B0+MiAp6Eg=="}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:05.610703 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-d7a79f87-7057-42a8-830f-a8955881ad6c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for project b967c22662da47aeb9292704c39b44bb. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:10:05.619005 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-d7a79f87-7057-42a8-830f-a8955881ad6c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for user ac0bc9e010d044a5a2147010cbdb4d85 and project b967c22662da47aeb9292704c39b44bb. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:10:05.654538 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d7a79f87-7057-42a8-830f-a8955881ad6c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.079998 Aug 29 19:10:05.655828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 179/350] 10.222.0.94 () {60 vars in 1159 bytes} [Mon Aug 29 19:10:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:05.748182 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ce6a659e-0245-41f6-a83b-e7e24392cb29 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:05.748804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ce6a659e-0245-41f6-a83b-e7e24392cb29 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:05.761306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce6a659e-0245-41f6-a83b-e7e24392cb29 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:05.762296 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce6a659e-0245-41f6-a83b-e7e24392cb29 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:05.762742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce6a659e-0245-41f6-a83b-e7e24392cb29 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:05.764777 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce6a659e-0245-41f6-a83b-e7e24392cb29 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:05.765282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce6a659e-0245-41f6-a83b-e7e24392cb29 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:05.765718 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce6a659e-0245-41f6-a83b-e7e24392cb29 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:06.042417 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ce6a659e-0245-41f6-a83b-e7e24392cb29 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:06.054827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ce6a659e-0245-41f6-a83b-e7e24392cb29 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.310533 Aug 29 19:10:06.066958 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 180/351] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:05 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:06.594570 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-86fea23c-e66e-4102-8985-b225fbb55104 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:06.595310 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-86fea23c-e66e-4102-8985-b225fbb55104 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:06.602476 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-86fea23c-e66e-4102-8985-b225fbb55104 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:06.602832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-86fea23c-e66e-4102-8985-b225fbb55104 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:06.603683 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-86fea23c-e66e-4102-8985-b225fbb55104 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:06.605182 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-86fea23c-e66e-4102-8985-b225fbb55104 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:06.605813 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-86fea23c-e66e-4102-8985-b225fbb55104 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:06.606416 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-86fea23c-e66e-4102-8985-b225fbb55104 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:06.785727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-86fea23c-e66e-4102-8985-b225fbb55104 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:06.794234 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-86fea23c-e66e-4102-8985-b225fbb55104 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.203546 Aug 29 19:10:06.795207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 181/352] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:06 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:06.833424 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:07.083109 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b4d06704-588a-44d9-8e13-605c367976e7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:07.084360 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b4d06704-588a-44d9-8e13-605c367976e7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:07.094928 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4d06704-588a-44d9-8e13-605c367976e7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:07.095908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4d06704-588a-44d9-8e13-605c367976e7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:07.096731 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4d06704-588a-44d9-8e13-605c367976e7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:07.097681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4d06704-588a-44d9-8e13-605c367976e7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:07.099294 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4d06704-588a-44d9-8e13-605c367976e7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:07.100096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4d06704-588a-44d9-8e13-605c367976e7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:07.126271 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:07.273854 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b4d06704-588a-44d9-8e13-605c367976e7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:07.282835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b4d06704-588a-44d9-8e13-605c367976e7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.205139 Aug 29 19:10:07.286177 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 182/353] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:07 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:07.291785 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1719842162", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "117b2cb0-1215-4254-9d1f-c2728d00a788"}], "security_groups": [{"name": "tempest-securitygroup--169175619"}], "key_name": "tempest-keypair-1470411950", "user_data": "}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:07.599338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5b457d5c-2990-4f9f-97e3-40ead6b92b56 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "POST /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/action" status: 202 len: 0 microversion: 2.20 time: 10.781595 Aug 29 19:10:07.600015 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 172/354] 10.222.0.94 () {62 vars in 1319 bytes} [Mon Aug 29 19:09:56 2022] POST /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/action => generated 0 bytes in 10783 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:10:07.610978 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:07.612351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:07.634450 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:07.635233 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:07.636264 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:07.637231 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:07.638068 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:07.638737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:07.740842 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.network.neutron [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] validate_networks() for [('117b2cb0-1215-4254-9d1f-c2728d00a788', None, None, None, None, None)] {{(pid=115968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:10:07.979208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:08.004025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:08.008676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:08.015829 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8ba46db2-7269-4fff-aa03-f330183cf03e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.408861 Aug 29 19:10:08.017214 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 173/355] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:07 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:08.026828 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d941978a-590b-4c54-b0d6-2ab1ffa54798 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:08.028456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d941978a-590b-4c54-b0d6-2ab1ffa54798 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:08.042793 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d941978a-590b-4c54-b0d6-2ab1ffa54798 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:08.043318 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d941978a-590b-4c54-b0d6-2ab1ffa54798 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:08.043849 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d941978a-590b-4c54-b0d6-2ab1ffa54798 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:08.044599 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d941978a-590b-4c54-b0d6-2ab1ffa54798 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:08.045373 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d941978a-590b-4c54-b0d6-2ab1ffa54798 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:08.045812 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d941978a-590b-4c54-b0d6-2ab1ffa54798 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:08.313430 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d941978a-590b-4c54-b0d6-2ab1ffa54798 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:08.322477 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d941978a-590b-4c54-b0d6-2ab1ffa54798 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.303722 Aug 29 19:10:08.323051 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 174/356] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:08 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:08.330047 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9aab2adb-cb15-424d-8369-e15448d7b1bb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:08.330937 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9aab2adb-cb15-424d-8369-e15448d7b1bb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:08.338094 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9aab2adb-cb15-424d-8369-e15448d7b1bb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:08.338516 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9aab2adb-cb15-424d-8369-e15448d7b1bb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:08.338958 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9aab2adb-cb15-424d-8369-e15448d7b1bb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:08.339721 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9aab2adb-cb15-424d-8369-e15448d7b1bb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:08.340181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9aab2adb-cb15-424d-8369-e15448d7b1bb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:08.341119 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9aab2adb-cb15-424d-8369-e15448d7b1bb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:08.450621 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Flavor limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:10:08.451063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Image limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:10:08.451847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Flavor pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:10:08.452411 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Image pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:10:08.452827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:10:08.462981 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:08.463619 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:08.464198 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:08.464939 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:08.465390 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:08.466000 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:08.485998 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for project b967c22662da47aeb9292704c39b44bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:10:08.490549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for user ac0bc9e010d044a5a2147010cbdb4d85 and project b967c22662da47aeb9292704c39b44bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:10:08.505819 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9aab2adb-cb15-424d-8369-e15448d7b1bb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:08.506045 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Going to run 1 instances... {{(pid=115968) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:10:08.509216 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:10:08.515064 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9aab2adb-cb15-424d-8369-e15448d7b1bb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.190148 Aug 29 19:10:08.515662 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 175/357] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:08 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:08.558020 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-52f6074f-308a-43f5-ac15-3490e35937af tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.270594 Aug 29 19:10:08.558675 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 183/358] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:10:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:10:08.569318 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-17e52bf3-b25b-4101-9e10-be858b7767b2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:08.569930 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-17e52bf3-b25b-4101-9e10-be858b7767b2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:08.641876 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-17e52bf3-b25b-4101-9e10-be858b7767b2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:08.650760 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-17e52bf3-b25b-4101-9e10-be858b7767b2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1242 microversion: 2.1 time: 0.085230 Aug 29 19:10:08.651922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 176/359] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:08 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:09.043563 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:09.044180 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:09.051899 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.052621 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.053054 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.053864 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.054344 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.054766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.237563 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:09.247179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:09.249162 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:09.250516 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f10e34fe-7fb9-427e-9c0b-f4616ddf3bcf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.211488 Aug 29 19:10:09.251257 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 184/360] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:09 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:09.344652 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-50ec9cf2-c389-4361-9d0b-fde95491fe2e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:09.346072 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-50ec9cf2-c389-4361-9d0b-fde95491fe2e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:09.352895 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50ec9cf2-c389-4361-9d0b-fde95491fe2e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.353698 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50ec9cf2-c389-4361-9d0b-fde95491fe2e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.354328 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50ec9cf2-c389-4361-9d0b-fde95491fe2e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.355300 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50ec9cf2-c389-4361-9d0b-fde95491fe2e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.355944 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50ec9cf2-c389-4361-9d0b-fde95491fe2e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.356572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50ec9cf2-c389-4361-9d0b-fde95491fe2e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.542072 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3dc14384-2778-43ef-a317-60eabfffed39 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:09.543086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3dc14384-2778-43ef-a317-60eabfffed39 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:09.559096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3dc14384-2778-43ef-a317-60eabfffed39 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.561008 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3dc14384-2778-43ef-a317-60eabfffed39 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.561957 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3dc14384-2778-43ef-a317-60eabfffed39 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.564240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3dc14384-2778-43ef-a317-60eabfffed39 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.565229 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3dc14384-2778-43ef-a317-60eabfffed39 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.566020 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3dc14384-2778-43ef-a317-60eabfffed39 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.896033 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-50ec9cf2-c389-4361-9d0b-fde95491fe2e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:09.916657 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-50ec9cf2-c389-4361-9d0b-fde95491fe2e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.576856 Aug 29 19:10:09.917851 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 177/361] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:09 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:09.948856 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0da390f5-c4bb-4f06-ba77-4dea04a5dbd5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:09.950958 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0da390f5-c4bb-4f06-ba77-4dea04a5dbd5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:09.963587 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da390f5-c4bb-4f06-ba77-4dea04a5dbd5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.964642 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da390f5-c4bb-4f06-ba77-4dea04a5dbd5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.965095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da390f5-c4bb-4f06-ba77-4dea04a5dbd5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.965967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da390f5-c4bb-4f06-ba77-4dea04a5dbd5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:09.966601 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da390f5-c4bb-4f06-ba77-4dea04a5dbd5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:09.967228 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0da390f5-c4bb-4f06-ba77-4dea04a5dbd5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:09.988950 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3dc14384-2778-43ef-a317-60eabfffed39 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:10.002059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3dc14384-2778-43ef-a317-60eabfffed39 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.467379 Aug 29 19:10:10.003372 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 185/362] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:09 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:10.053890 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0da390f5-c4bb-4f06-ba77-4dea04a5dbd5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:10.065397 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0da390f5-c4bb-4f06-ba77-4dea04a5dbd5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1294 microversion: 2.1 time: 0.144862 Aug 29 19:10:10.067130 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 178/363] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:09 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1294 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:10.277209 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:10.279592 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:10.287414 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:10.288154 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:10.289074 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:10.290498 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:10.290960 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:10.291699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:10.311580 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:10.476940 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:10.487774 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:10.489853 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:10.491495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a0f043ee-0c9f-41da-b364-3e8f38c26543 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.219663 Aug 29 19:10:10.492230 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 186/364] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:10 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:10.941669 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0b6a3af2-ace6-43ea-8cc0-7c24906003cb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:10.942790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0b6a3af2-ace6-43ea-8cc0-7c24906003cb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:10.952486 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b6a3af2-ace6-43ea-8cc0-7c24906003cb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:10.953002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b6a3af2-ace6-43ea-8cc0-7c24906003cb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:10.954057 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b6a3af2-ace6-43ea-8cc0-7c24906003cb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:10.955187 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b6a3af2-ace6-43ea-8cc0-7c24906003cb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:10.955944 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b6a3af2-ace6-43ea-8cc0-7c24906003cb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:10.957044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b6a3af2-ace6-43ea-8cc0-7c24906003cb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:11.027758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b4e3f1a1-d18e-4f14-a5dd-742a42944c33 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:11.028527 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b4e3f1a1-d18e-4f14-a5dd-742a42944c33 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:11.039106 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4e3f1a1-d18e-4f14-a5dd-742a42944c33 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:11.040182 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4e3f1a1-d18e-4f14-a5dd-742a42944c33 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:11.041348 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4e3f1a1-d18e-4f14-a5dd-742a42944c33 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:11.042497 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4e3f1a1-d18e-4f14-a5dd-742a42944c33 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:11.043305 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4e3f1a1-d18e-4f14-a5dd-742a42944c33 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:11.044043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4e3f1a1-d18e-4f14-a5dd-742a42944c33 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:11.264892 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0b6a3af2-ace6-43ea-8cc0-7c24906003cb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:11.279182 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0b6a3af2-ace6-43ea-8cc0-7c24906003cb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.344795 Aug 29 19:10:11.279899 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 179/365] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:10 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:11.287794 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-61a84b8b-d489-42ed-a3c3-15966eca63be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:11.288662 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-61a84b8b-d489-42ed-a3c3-15966eca63be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:11.295835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61a84b8b-d489-42ed-a3c3-15966eca63be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:11.296470 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61a84b8b-d489-42ed-a3c3-15966eca63be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:11.297012 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61a84b8b-d489-42ed-a3c3-15966eca63be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:11.297888 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61a84b8b-d489-42ed-a3c3-15966eca63be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:11.298539 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61a84b8b-d489-42ed-a3c3-15966eca63be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:11.299121 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61a84b8b-d489-42ed-a3c3-15966eca63be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:11.305360 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b4e3f1a1-d18e-4f14-a5dd-742a42944c33 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:11.313967 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b4e3f1a1-d18e-4f14-a5dd-742a42944c33 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.291672 Aug 29 19:10:11.314686 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 187/366] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:11 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:11.397621 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-61a84b8b-d489-42ed-a3c3-15966eca63be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:11.409585 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-61a84b8b-d489-42ed-a3c3-15966eca63be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1294 microversion: 2.1 time: 0.124850 Aug 29 19:10:11.410169 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 180/367] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:11 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1294 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:11.516730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:11.517332 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:11.523288 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:11.523770 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:11.525133 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:11.525909 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:11.526360 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:11.526965 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:11.684228 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:11.693636 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:11.697147 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:11.698964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b6b8704b-be12-431d-b843-b7790d767a64 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.186055 Aug 29 19:10:11.707581 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 188/368] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:11 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:12.299966 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2a8c5d0a-c6be-4a05-85b1-a0f5e61e35b8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:12.300695 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2a8c5d0a-c6be-4a05-85b1-a0f5e61e35b8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:12.309684 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8c5d0a-c6be-4a05-85b1-a0f5e61e35b8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.310778 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8c5d0a-c6be-4a05-85b1-a0f5e61e35b8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.311716 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8c5d0a-c6be-4a05-85b1-a0f5e61e35b8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.313111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8c5d0a-c6be-4a05-85b1-a0f5e61e35b8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.314301 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8c5d0a-c6be-4a05-85b1-a0f5e61e35b8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.315245 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8c5d0a-c6be-4a05-85b1-a0f5e61e35b8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.337298 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6fff03d2-5d08-4318-9c95-f395cb3f66eb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:12.338094 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6fff03d2-5d08-4318-9c95-f395cb3f66eb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:12.346267 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6fff03d2-5d08-4318-9c95-f395cb3f66eb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.347014 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6fff03d2-5d08-4318-9c95-f395cb3f66eb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.347678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6fff03d2-5d08-4318-9c95-f395cb3f66eb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.348413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6fff03d2-5d08-4318-9c95-f395cb3f66eb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.348870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6fff03d2-5d08-4318-9c95-f395cb3f66eb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.349401 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6fff03d2-5d08-4318-9c95-f395cb3f66eb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.890159 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2a8c5d0a-c6be-4a05-85b1-a0f5e61e35b8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:12.899120 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2a8c5d0a-c6be-4a05-85b1-a0f5e61e35b8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1503 microversion: 2.1 time: 0.602858 Aug 29 19:10:12.900276 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 181/369] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:12 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1503 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:12.921297 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b9aac561-b7c4-4e7c-adf8-04d18d190f41 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:12.922115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b9aac561-b7c4-4e7c-adf8-04d18d190f41 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:12.928796 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9aac561-b7c4-4e7c-adf8-04d18d190f41 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.929427 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9aac561-b7c4-4e7c-adf8-04d18d190f41 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.929653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6fff03d2-5d08-4318-9c95-f395cb3f66eb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:12.930708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9aac561-b7c4-4e7c-adf8-04d18d190f41 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.931988 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9aac561-b7c4-4e7c-adf8-04d18d190f41 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.932552 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9aac561-b7c4-4e7c-adf8-04d18d190f41 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.933085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9aac561-b7c4-4e7c-adf8-04d18d190f41 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.939484 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6fff03d2-5d08-4318-9c95-f395cb3f66eb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.606946 Aug 29 19:10:12.953543 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 189/370] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:12 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:12.958498 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:12.959363 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:12.969801 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.970484 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.971096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:12.971815 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:12.972430 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:12.972855 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.027464 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b9aac561-b7c4-4e7c-adf8-04d18d190f41 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:13.038813 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b9aac561-b7c4-4e7c-adf8-04d18d190f41 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1300 microversion: 2.1 time: 0.121325 Aug 29 19:10:13.039564 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 182/371] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:12 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:13.047767 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e0983d6-0233-49a7-8603-5ce8bbd4445c"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:13.050227 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:13.056685 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.057186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.057627 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.058736 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.059414 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.060038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.092653 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] HTTP exception thrown: Cannot 'attach_volume' instance b28b5c17-0afa-4fff-a814-653688b1231b while it is in vm_state rescued Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Request method failure captured: Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: POST /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b/os-volume_attachments HTTP/1.1 Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 74 Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6E5qq19XpHwlOHkTbjyma9QlFTrqFt7b9-twpMAOXdQdC0jV3pWUGE_MXRfTm_NQ3UnXuJjxiqQl_lHPtfUSarmRjbywIggIk9H_6vW-4_SeCMX7AMBMSIiCdM2J_TOMs4lmb3ACxn7AXkq0BEDSHTDmoEaY1zLgOYRdtjW6wZifc Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: b429eb37f4ed408d830ef2c1034e9bdc Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:10:13.095338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b429eb37f4ed408d830ef2c1034e9bdc"}]}] Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: b429eb37f4ed408d830ef2c1034e9bdc Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-ServerRescueNegativeTestJSON-1171381257-project Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 73c4a7ab7fc7425389843798faa25372 Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1171381257-project Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {"volumeAttachment": {"volumeId": "7e0983d6-0233-49a7-8603-5ce8bbd4445c"}} Aug 29 19:10:13.096719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Cannot 'attach_volume' instance b28b5c17-0afa-4fff-a814-653688b1231b while it is in vm_state rescued Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'server_id': 'b28b5c17-0afa-4fff-a814-653688b1231b', 'body': {'volumeAttachment': {'volumeId': '7e0983d6-0233-49a7-8603-5ce8bbd4445c'}}} Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b28b5c17-0afa-4fff-a814-653688b1231b in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:10:13.097439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b28b5c17-0afa-4fff-a814-653688b1231b while it is in vm_state rescued Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:10:13.098566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:10:13.100572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:10:13.100572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:10:13.100572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b28b5c17-0afa-4fff-a814-653688b1231b while it is in vm_state rescued Aug 29 19:10:13.100572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:10:13.103451 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Returning 409 to user: Cannot 'attach_volume' instance b28b5c17-0afa-4fff-a814-653688b1231b while it is in vm_state rescued {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:10:13.105093 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3be279d7-438d-4a15-a71a-89b2cafe8c47 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "POST /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.063901 Aug 29 19:10:13.106504 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 183/372] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:10:13 2022] POST /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 19:10:13.114823 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6e09fc24-2366-453a-ab8d-1a31b1aecb74 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:13.115390 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6e09fc24-2366-453a-ab8d-1a31b1aecb74 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:13.122535 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e09fc24-2366-453a-ab8d-1a31b1aecb74 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.123165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e09fc24-2366-453a-ab8d-1a31b1aecb74 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.123664 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e09fc24-2366-453a-ab8d-1a31b1aecb74 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.124294 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e09fc24-2366-453a-ab8d-1a31b1aecb74 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.124836 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e09fc24-2366-453a-ab8d-1a31b1aecb74 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.125271 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e09fc24-2366-453a-ab8d-1a31b1aecb74 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.217372 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6e09fc24-2366-453a-ab8d-1a31b1aecb74 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "POST /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b/action" status: 202 len: 0 microversion: 2.1 time: 0.105999 Aug 29 19:10:13.217995 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 184/373] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:10:13 2022] POST /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:10:13.228488 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-61c60dbf-daee-4d22-8bc2-a4e38b0313b3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:13.229408 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-61c60dbf-daee-4d22-8bc2-a4e38b0313b3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:13.236067 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61c60dbf-daee-4d22-8bc2-a4e38b0313b3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.236844 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61c60dbf-daee-4d22-8bc2-a4e38b0313b3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.237377 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61c60dbf-daee-4d22-8bc2-a4e38b0313b3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.237688 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:13.238287 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61c60dbf-daee-4d22-8bc2-a4e38b0313b3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.238830 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61c60dbf-daee-4d22-8bc2-a4e38b0313b3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.239575 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61c60dbf-daee-4d22-8bc2-a4e38b0313b3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.250373 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:13.252504 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:13.254475 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8be41ceb-7705-4a18-8f96-65a920a078c5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.299777 Aug 29 19:10:13.272103 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 190/374] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:12 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:13.558571 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-61c60dbf-daee-4d22-8bc2-a4e38b0313b3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:13.575709 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-61c60dbf-daee-4d22-8bc2-a4e38b0313b3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1511 microversion: 2.1 time: 0.351243 Aug 29 19:10:13.591104 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 185/375] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:13 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1511 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:13.961150 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ba47146e-72db-424a-b8e2-054e9f5716dd tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:13.962239 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ba47146e-72db-424a-b8e2-054e9f5716dd tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:13.969323 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba47146e-72db-424a-b8e2-054e9f5716dd tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.969814 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba47146e-72db-424a-b8e2-054e9f5716dd tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.970421 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba47146e-72db-424a-b8e2-054e9f5716dd tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:13.971153 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba47146e-72db-424a-b8e2-054e9f5716dd tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:13.971627 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba47146e-72db-424a-b8e2-054e9f5716dd tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:13.972038 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba47146e-72db-424a-b8e2-054e9f5716dd tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:14.061782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cff28f98-fb1e-44d9-8658-077baeb0ae38 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:14.062601 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cff28f98-fb1e-44d9-8658-077baeb0ae38 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:14.069237 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cff28f98-fb1e-44d9-8658-077baeb0ae38 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:14.070043 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cff28f98-fb1e-44d9-8658-077baeb0ae38 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:14.070510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cff28f98-fb1e-44d9-8658-077baeb0ae38 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:14.072059 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cff28f98-fb1e-44d9-8658-077baeb0ae38 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:14.072744 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cff28f98-fb1e-44d9-8658-077baeb0ae38 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:14.073581 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cff28f98-fb1e-44d9-8658-077baeb0ae38 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:14.382019 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ba47146e-72db-424a-b8e2-054e9f5716dd tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:14.395824 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ba47146e-72db-424a-b8e2-054e9f5716dd tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.438929 Aug 29 19:10:14.397031 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 191/376] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:13 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:14.404450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:14.405507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:14.415703 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:14.433679 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:14.436566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:14.438905 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:14.444175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:14.444328 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:14.478494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cff28f98-fb1e-44d9-8658-077baeb0ae38 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:14.489257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cff28f98-fb1e-44d9-8658-077baeb0ae38 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1367 microversion: 2.1 time: 0.431852 Aug 29 19:10:14.490135 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 186/377] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:14 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:14.597628 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-66a96748-28f4-4907-88b8-4e042613dddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:14.598267 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-66a96748-28f4-4907-88b8-4e042613dddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:14.604552 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66a96748-28f4-4907-88b8-4e042613dddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:14.605286 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66a96748-28f4-4907-88b8-4e042613dddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:14.605903 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66a96748-28f4-4907-88b8-4e042613dddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:14.606760 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66a96748-28f4-4907-88b8-4e042613dddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:14.607403 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66a96748-28f4-4907-88b8-4e042613dddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:14.608002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66a96748-28f4-4907-88b8-4e042613dddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:14.855190 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:14.865722 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:14.869340 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:14.871465 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-4b46515b-2f00-4781-98dd-d29f7e311062 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.472598 Aug 29 19:10:14.872329 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 192/378] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:14 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:15.022882 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-66a96748-28f4-4907-88b8-4e042613dddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:15.031385 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-66a96748-28f4-4907-88b8-4e042613dddc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1511 microversion: 2.1 time: 0.437384 Aug 29 19:10:15.031881 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 187/379] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:14 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:15.278354 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-ec14a902-89af-4132-9df5-d34f63ef048a req-eb9aceae-d77a-4469-a62d-33e5a1e9627b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a8cf0d-0651-4bf9-9fc2-24a66d1528a0", "tag": "7d4b5dab-5d4d-4df3-a064-13f32c7a8555"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:15.309442 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ec14a902-89af-4132-9df5-d34f63ef048a req-eb9aceae-d77a-4469-a62d-33e5a1e9627b service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:15.309924 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ec14a902-89af-4132-9df5-d34f63ef048a req-eb9aceae-d77a-4469-a62d-33e5a1e9627b service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:15.310349 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ec14a902-89af-4132-9df5-d34f63ef048a req-eb9aceae-d77a-4469-a62d-33e5a1e9627b service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:15.329175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-ec14a902-89af-4132-9df5-d34f63ef048a req-eb9aceae-d77a-4469-a62d-33e5a1e9627b service nova] Creating event network-changed:7d4b5dab-5d4d-4df3-a064-13f32c7a8555 for instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 on hv-cinder-73126 Aug 29 19:10:15.334976 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-ec14a902-89af-4132-9df5-d34f63ef048a req-eb9aceae-d77a-4469-a62d-33e5a1e9627b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061946 Aug 29 19:10:15.335647 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 193/380] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:15.427779 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6e8530c5-0c35-4f88-bf98-28edfb0f5b82 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:15.428364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6e8530c5-0c35-4f88-bf98-28edfb0f5b82 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:15.436510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e8530c5-0c35-4f88-bf98-28edfb0f5b82 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:15.436888 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e8530c5-0c35-4f88-bf98-28edfb0f5b82 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:15.437617 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e8530c5-0c35-4f88-bf98-28edfb0f5b82 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:15.440785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e8530c5-0c35-4f88-bf98-28edfb0f5b82 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:15.440785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e8530c5-0c35-4f88-bf98-28edfb0f5b82 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:15.441889 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e8530c5-0c35-4f88-bf98-28edfb0f5b82 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:15.516053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e6462dd2-8c77-4c89-96f2-52a72203cb12 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:15.516805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e6462dd2-8c77-4c89-96f2-52a72203cb12 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:15.523274 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6462dd2-8c77-4c89-96f2-52a72203cb12 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:15.524593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6462dd2-8c77-4c89-96f2-52a72203cb12 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:15.525283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6462dd2-8c77-4c89-96f2-52a72203cb12 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:15.526863 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6462dd2-8c77-4c89-96f2-52a72203cb12 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:15.527519 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6462dd2-8c77-4c89-96f2-52a72203cb12 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:15.527945 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e6462dd2-8c77-4c89-96f2-52a72203cb12 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:15.668061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6e8530c5-0c35-4f88-bf98-28edfb0f5b82 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:15.679466 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6e8530c5-0c35-4f88-bf98-28edfb0f5b82 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.255894 Aug 29 19:10:15.697046 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 188/381] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:15 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:15.737531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e6462dd2-8c77-4c89-96f2-52a72203cb12 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:15.747794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e6462dd2-8c77-4c89-96f2-52a72203cb12 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1367 microversion: 2.1 time: 0.238369 Aug 29 19:10:15.764086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 194/382] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:15 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:15.895782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:15.896423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:15.903154 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:15.903790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:15.904279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:15.905369 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:15.905921 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:15.906512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:16.056712 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5f0ea6ab-3686-48ec-b1df-50c53d5ddb83 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:16.057762 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5f0ea6ab-3686-48ec-b1df-50c53d5ddb83 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:16.064109 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f0ea6ab-3686-48ec-b1df-50c53d5ddb83 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:16.064599 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f0ea6ab-3686-48ec-b1df-50c53d5ddb83 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:16.065025 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f0ea6ab-3686-48ec-b1df-50c53d5ddb83 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:16.066008 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f0ea6ab-3686-48ec-b1df-50c53d5ddb83 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:16.066678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f0ea6ab-3686-48ec-b1df-50c53d5ddb83 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:16.067631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f0ea6ab-3686-48ec-b1df-50c53d5ddb83 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:16.081024 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:16.084881 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:16.091520 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:16.093191 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:16.094609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-91a00301-8018-46a5-8222-b44684c8d757 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.203127 Aug 29 19:10:16.095177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 189/383] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:15 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:16.215536 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5f0ea6ab-3686-48ec-b1df-50c53d5ddb83 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:16.226167 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5f0ea6ab-3686-48ec-b1df-50c53d5ddb83 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1511 microversion: 2.1 time: 0.174769 Aug 29 19:10:16.226930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 195/384] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:16 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:16.704808 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-317b24fe-f629-437a-9788-5d84a2b9e5fb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:16.705456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-317b24fe-f629-437a-9788-5d84a2b9e5fb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:16.715113 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-317b24fe-f629-437a-9788-5d84a2b9e5fb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:16.715611 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-317b24fe-f629-437a-9788-5d84a2b9e5fb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:16.716048 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-317b24fe-f629-437a-9788-5d84a2b9e5fb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:16.716736 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-317b24fe-f629-437a-9788-5d84a2b9e5fb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:16.717187 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-317b24fe-f629-437a-9788-5d84a2b9e5fb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:16.717609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-317b24fe-f629-437a-9788-5d84a2b9e5fb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:16.772568 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-999db505-4af1-4cba-9de6-c46cb82378e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:16.773862 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-999db505-4af1-4cba-9de6-c46cb82378e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:16.781991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-999db505-4af1-4cba-9de6-c46cb82378e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:16.782952 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-999db505-4af1-4cba-9de6-c46cb82378e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:16.784080 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-999db505-4af1-4cba-9de6-c46cb82378e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:16.784920 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-999db505-4af1-4cba-9de6-c46cb82378e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:16.785485 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-999db505-4af1-4cba-9de6-c46cb82378e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:16.786134 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-999db505-4af1-4cba-9de6-c46cb82378e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:16.982585 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-317b24fe-f629-437a-9788-5d84a2b9e5fb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:16.997694 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-317b24fe-f629-437a-9788-5d84a2b9e5fb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.296991 Aug 29 19:10:16.998376 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 190/385] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:16 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:17.019171 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-999db505-4af1-4cba-9de6-c46cb82378e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:17.027492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-999db505-4af1-4cba-9de6-c46cb82378e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1367 microversion: 2.1 time: 0.259751 Aug 29 19:10:17.028055 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 196/386] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:16 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:17.117936 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:17.118887 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:17.125002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:17.125491 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:17.125929 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:17.126622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:17.127103 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:17.127527 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:17.248287 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e05093d7-a403-4446-bf31-0e2a70d6cc0c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:17.248907 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e05093d7-a403-4446-bf31-0e2a70d6cc0c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:17.255408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e05093d7-a403-4446-bf31-0e2a70d6cc0c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:17.256221 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e05093d7-a403-4446-bf31-0e2a70d6cc0c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:17.256961 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e05093d7-a403-4446-bf31-0e2a70d6cc0c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:17.258722 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e05093d7-a403-4446-bf31-0e2a70d6cc0c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:17.259826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e05093d7-a403-4446-bf31-0e2a70d6cc0c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:17.260584 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e05093d7-a403-4446-bf31-0e2a70d6cc0c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:17.263503 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:17.272116 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:17.274800 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:17.276408 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e4a81ebc-f451-4e34-be70-518b1e74e22a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.162549 Aug 29 19:10:17.277409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 191/387] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:17 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:17.450284 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e05093d7-a403-4446-bf31-0e2a70d6cc0c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:17.458362 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e05093d7-a403-4446-bf31-0e2a70d6cc0c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1517 microversion: 2.1 time: 0.214773 Aug 29 19:10:17.459089 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 197/388] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:17 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:18.019275 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7116a0be-4917-4880-a971-c39f0315ac9a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:18.019864 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7116a0be-4917-4880-a971-c39f0315ac9a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:18.026464 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7116a0be-4917-4880-a971-c39f0315ac9a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:18.026950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7116a0be-4917-4880-a971-c39f0315ac9a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:18.027416 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7116a0be-4917-4880-a971-c39f0315ac9a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:18.028102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7116a0be-4917-4880-a971-c39f0315ac9a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:18.028555 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7116a0be-4917-4880-a971-c39f0315ac9a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:18.028981 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7116a0be-4917-4880-a971-c39f0315ac9a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:18.048730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3fe6c6bf-03b3-4f6e-ba18-73d5acd525d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:18.049343 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3fe6c6bf-03b3-4f6e-ba18-73d5acd525d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:18.055826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3fe6c6bf-03b3-4f6e-ba18-73d5acd525d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:18.056316 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3fe6c6bf-03b3-4f6e-ba18-73d5acd525d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:18.056750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3fe6c6bf-03b3-4f6e-ba18-73d5acd525d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:18.057634 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3fe6c6bf-03b3-4f6e-ba18-73d5acd525d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:18.058091 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3fe6c6bf-03b3-4f6e-ba18-73d5acd525d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:18.058511 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3fe6c6bf-03b3-4f6e-ba18-73d5acd525d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:18.261238 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7116a0be-4917-4880-a971-c39f0315ac9a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:18.269554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7116a0be-4917-4880-a971-c39f0315ac9a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.254135 Aug 29 19:10:18.270128 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 192/389] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:18 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:18.278507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3fe6c6bf-03b3-4f6e-ba18-73d5acd525d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:18.286450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3fe6c6bf-03b3-4f6e-ba18-73d5acd525d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1367 microversion: 2.1 time: 0.241544 Aug 29 19:10:18.287006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 198/390] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:18 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:18.302902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:18.303622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:18.310327 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:18.310835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:18.311298 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:18.311994 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:18.312444 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:18.312866 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:18.521158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:18.531002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:18.532656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:18.534199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-50e80553-4bc1-4d94-9b17-2281b193b588 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.234968 Aug 29 19:10:18.535177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 193/391] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:18 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:18.828724 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9acdf001-1af8-4b9a-bd76-42a2bf52c66a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Action: 'create', calling method: .version_select at 0x7f3d7655c700>, body: {"keypair": {"name": "tempest-keypair-1985167894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOgcFfvzzBlBUUGIGhGFAcGq8HdB98QTmltd7eayKZy/gk0O/gTmq8UvQu7pM7AZ0+TEebfK8C5uCM6YZotKkclBzC1v0QRnbkr+tGRoAqDoRjzD8p8hnvW/D4UVvhyLg=="}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:18.834179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:18.835584 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=14 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:18.848120 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-9acdf001-1af8-4b9a-bd76-42a2bf52c66a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Getting quotas for project b429eb37f4ed408d830ef2c1034e9bdc. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:10:18.852092 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-9acdf001-1af8-4b9a-bd76-42a2bf52c66a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Getting quotas for user 73c4a7ab7fc7425389843798faa25372 and project b429eb37f4ed408d830ef2c1034e9bdc. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:10:18.854323 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:18.875621 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9acdf001-1af8-4b9a-bd76-42a2bf52c66a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050701 Aug 29 19:10:18.876212 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 199/392] 10.222.0.94 () {60 vars in 1159 bytes} [Mon Aug 29 19:10:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:19.292253 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-db759f20-dedc-4193-afce-571a71744c2f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:19.292880 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-db759f20-dedc-4193-afce-571a71744c2f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:19.294751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:19.300379 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-db759f20-dedc-4193-afce-571a71744c2f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:19.301181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-db759f20-dedc-4193-afce-571a71744c2f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:19.301639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-db759f20-dedc-4193-afce-571a71744c2f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:19.302344 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-db759f20-dedc-4193-afce-571a71744c2f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:19.302802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-db759f20-dedc-4193-afce-571a71744c2f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:19.303422 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-db759f20-dedc-4193-afce-571a71744c2f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:19.307703 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-27c7832c-744b-4b3d-aca0-330c5e0977ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:19.309009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-27c7832c-744b-4b3d-aca0-330c5e0977ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:19.315986 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27c7832c-744b-4b3d-aca0-330c5e0977ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:19.316570 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27c7832c-744b-4b3d-aca0-330c5e0977ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:19.317072 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27c7832c-744b-4b3d-aca0-330c5e0977ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:19.317846 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27c7832c-744b-4b3d-aca0-330c5e0977ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:19.318362 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27c7832c-744b-4b3d-aca0-330c5e0977ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:19.319053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27c7832c-744b-4b3d-aca0-330c5e0977ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:19.522428 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-db759f20-dedc-4193-afce-571a71744c2f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:19.535170 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-db759f20-dedc-4193-afce-571a71744c2f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.247628 Aug 29 19:10:19.543632 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-27c7832c-744b-4b3d-aca0-330c5e0977ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:19.547129 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 194/393] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:19 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:19.551358 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-27c7832c-744b-4b3d-aca0-330c5e0977ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1367 microversion: 2.1 time: 0.249402 Aug 29 19:10:19.552184 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 200/394] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:19 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:19.577771 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:19.578574 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:19.586393 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:19.589076 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:19.589572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:19.590298 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:19.590755 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:19.591439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:19.754967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:19.764008 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:19.765588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:19.766894 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-be37a0cd-3de6-4025-874b-366468419111 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.192997 Aug 29 19:10:19.768085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 195/395] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:19 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:20.330692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-674609724", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9853bcbc-2750-4a4b-ae35-877c673fbf89"}], "security_groups": [{"name": "tempest-securitygroup--732886689"}], "key_name": "tempest-keypair-1985167894", "user_data": "}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:20.436836 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.network.neutron [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] validate_networks() for [('9853bcbc-2750-4a4b-ae35-877c673fbf89', None, None, None, None, None)] {{(pid=115968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:10:20.556964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bc613f44-aea5-413e-b192-73af26449aff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:20.558421 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bc613f44-aea5-413e-b192-73af26449aff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:20.565839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc613f44-aea5-413e-b192-73af26449aff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:20.566330 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc613f44-aea5-413e-b192-73af26449aff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:20.566766 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc613f44-aea5-413e-b192-73af26449aff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:20.570943 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc613f44-aea5-413e-b192-73af26449aff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:20.572243 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc613f44-aea5-413e-b192-73af26449aff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:20.572883 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc613f44-aea5-413e-b192-73af26449aff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:21.061913 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-bc613f44-aea5-413e-b192-73af26449aff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:21.070457 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bc613f44-aea5-413e-b192-73af26449aff tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1725 microversion: 2.1 time: 0.517786 Aug 29 19:10:21.071713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 196/396] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:20 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1725 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:21.090399 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b89aa962-9c4e-4244-ad94-34c2a16c5e1f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:21.091512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b89aa962-9c4e-4244-ad94-34c2a16c5e1f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:21.104097 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b89aa962-9c4e-4244-ad94-34c2a16c5e1f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:21.104599 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b89aa962-9c4e-4244-ad94-34c2a16c5e1f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:21.105054 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b89aa962-9c4e-4244-ad94-34c2a16c5e1f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:21.105911 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b89aa962-9c4e-4244-ad94-34c2a16c5e1f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:21.106434 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b89aa962-9c4e-4244-ad94-34c2a16c5e1f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:21.106897 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b89aa962-9c4e-4244-ad94-34c2a16c5e1f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:21.237866 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Flavor limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:10:21.238288 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Image limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:10:21.238783 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Flavor pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:10:21.239213 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Image pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:10:21.239632 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:10:21.248638 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:21.249123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:21.249550 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:21.250266 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:21.250717 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:21.251162 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:21.269533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b89aa962-9c4e-4244-ad94-34c2a16c5e1f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:21.271659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Getting quotas for project b429eb37f4ed408d830ef2c1034e9bdc. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:10:21.276529 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Getting quotas for user 73c4a7ab7fc7425389843798faa25372 and project b429eb37f4ed408d830ef2c1034e9bdc. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:10:21.278293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b89aa962-9c4e-4244-ad94-34c2a16c5e1f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1367 microversion: 2.1 time: 0.192600 Aug 29 19:10:21.279106 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 197/397] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:21 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:21.288290 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Going to run 1 instances... {{(pid=115968) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:10:21.289204 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:21.290000 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:21.290963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:10:21.295930 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:21.296492 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:21.296929 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:21.297623 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:21.298078 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:21.298497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:21.348696 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3d2a472e-742b-4719-93aa-89e7147e8969 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.022014 Aug 29 19:10:21.349290 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 201/398] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:10:20 2022] POST /compute/v2.1/servers => generated 408 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:10:21.360980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-32acb60c-6be0-477c-bd63-4eea571df884 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:21.361601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-32acb60c-6be0-477c-bd63-4eea571df884 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:21.451684 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-32acb60c-6be0-477c-bd63-4eea571df884 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:21.460516 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-32acb60c-6be0-477c-bd63-4eea571df884 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1245 microversion: 2.1 time: 0.103101 Aug 29 19:10:21.462884 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 202/399] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:21 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1245 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:21.515668 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:21.531242 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:21.533332 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:21.535172 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-869d42ed-e1da-43de-b6ae-3c26ba71896b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.250521 Aug 29 19:10:21.551324 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 198/400] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:21 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:22.095492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8277ac22-ac43-4d0f-a581-a7cd85e804f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:22.096112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8277ac22-ac43-4d0f-a581-a7cd85e804f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:22.104470 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8277ac22-ac43-4d0f-a581-a7cd85e804f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.105621 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8277ac22-ac43-4d0f-a581-a7cd85e804f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.106282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8277ac22-ac43-4d0f-a581-a7cd85e804f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.107413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8277ac22-ac43-4d0f-a581-a7cd85e804f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.108304 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8277ac22-ac43-4d0f-a581-a7cd85e804f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.108834 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8277ac22-ac43-4d0f-a581-a7cd85e804f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.288960 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8277ac22-ac43-4d0f-a581-a7cd85e804f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:22.299604 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-71e104e7-83aa-465a-9c23-6cbf0c08ad4f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:22.301024 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-71e104e7-83aa-465a-9c23-6cbf0c08ad4f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:22.304790 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8277ac22-ac43-4d0f-a581-a7cd85e804f5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1702 microversion: 2.1 time: 0.213958 Aug 29 19:10:22.305751 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 203/401] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:22 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1702 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:22.310331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71e104e7-83aa-465a-9c23-6cbf0c08ad4f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.311760 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71e104e7-83aa-465a-9c23-6cbf0c08ad4f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.312326 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71e104e7-83aa-465a-9c23-6cbf0c08ad4f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.313186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71e104e7-83aa-465a-9c23-6cbf0c08ad4f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.314166 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71e104e7-83aa-465a-9c23-6cbf0c08ad4f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.314699 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71e104e7-83aa-465a-9c23-6cbf0c08ad4f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.326548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-95cf5ee5-c4be-483d-bf1e-92655ea010aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:22.333478 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95cf5ee5-c4be-483d-bf1e-92655ea010aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.334321 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95cf5ee5-c4be-483d-bf1e-92655ea010aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.335182 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95cf5ee5-c4be-483d-bf1e-92655ea010aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.375149 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-95cf5ee5-c4be-483d-bf1e-92655ea010aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Going to try to start instance {{(pid=115968) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 19:10:22.453567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-95cf5ee5-c4be-483d-bf1e-92655ea010aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "POST /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/action" status: 202 len: 0 microversion: 2.1 time: 0.130947 Aug 29 19:10:22.454197 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 204/402] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:10:22 2022] POST /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:10:22.463647 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-16d17008-d631-4866-84f4-c3e4da4a1e4c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:22.464955 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-16d17008-d631-4866-84f4-c3e4da4a1e4c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:22.471732 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16d17008-d631-4866-84f4-c3e4da4a1e4c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.472541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16d17008-d631-4866-84f4-c3e4da4a1e4c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.473172 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16d17008-d631-4866-84f4-c3e4da4a1e4c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.474210 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16d17008-d631-4866-84f4-c3e4da4a1e4c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.474868 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16d17008-d631-4866-84f4-c3e4da4a1e4c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.475509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16d17008-d631-4866-84f4-c3e4da4a1e4c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.500798 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:22.519622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-71e104e7-83aa-465a-9c23-6cbf0c08ad4f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:22.541725 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-71e104e7-83aa-465a-9c23-6cbf0c08ad4f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1367 microversion: 2.1 time: 0.245643 Aug 29 19:10:22.544309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 199/403] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:22 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:22.552765 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c598c951-38e6-4d6e-8004-7ee76d8cc932 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:22.555143 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c598c951-38e6-4d6e-8004-7ee76d8cc932 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:22.563812 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c598c951-38e6-4d6e-8004-7ee76d8cc932 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.565512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c598c951-38e6-4d6e-8004-7ee76d8cc932 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.566143 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c598c951-38e6-4d6e-8004-7ee76d8cc932 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.567779 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c598c951-38e6-4d6e-8004-7ee76d8cc932 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.568436 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c598c951-38e6-4d6e-8004-7ee76d8cc932 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.569364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c598c951-38e6-4d6e-8004-7ee76d8cc932 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.670792 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c598c951-38e6-4d6e-8004-7ee76d8cc932 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:22.679645 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c598c951-38e6-4d6e-8004-7ee76d8cc932 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1297 microversion: 2.1 time: 0.133019 Aug 29 19:10:22.680227 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 200/404] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:22 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1297 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:22.690366 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:22.691321 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:22.693533 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-16d17008-d631-4866-84f4-c3e4da4a1e4c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:22.699209 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.699711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.700150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.700858 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.701314 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.701822 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.703048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-16d17008-d631-4866-84f4-c3e4da4a1e4c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1711 microversion: 2.1 time: 0.244474 Aug 29 19:10:22.703874 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 205/405] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:22 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1711 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:22.720718 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ea48239f-b889-453a-b03a-96c92f6a0fbc tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4e9ded6-5043-4b54-9584-7f85465f86a2", "device": "/dev/sdb"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:22.724699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ea48239f-b889-453a-b03a-96c92f6a0fbc tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:22.732653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ea48239f-b889-453a-b03a-96c92f6a0fbc tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.733387 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ea48239f-b889-453a-b03a-96c92f6a0fbc tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.734003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ea48239f-b889-453a-b03a-96c92f6a0fbc tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.735256 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ea48239f-b889-453a-b03a-96c92f6a0fbc tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:22.735962 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ea48239f-b889-453a-b03a-96c92f6a0fbc tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:22.736695 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ea48239f-b889-453a-b03a-96c92f6a0fbc tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:22.876495 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:22.885238 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:22.887858 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:22.889328 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a01f9ae0-fc22-4ec1-a4d2-0d0684b1c9c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.207581 Aug 29 19:10:22.890049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 201/406] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:22 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:23.556721 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ea48239f-b889-453a-b03a-96c92f6a0fbc tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "POST /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.841532 Aug 29 19:10:23.557851 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 206/407] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:10:22 2022] POST /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:23.562943 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-502f3613-8d40-4c82-a24a-d7b018d9f5aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:23.563598 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-502f3613-8d40-4c82-a24a-d7b018d9f5aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:23.570039 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-502f3613-8d40-4c82-a24a-d7b018d9f5aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.570539 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-502f3613-8d40-4c82-a24a-d7b018d9f5aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.570976 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-502f3613-8d40-4c82-a24a-d7b018d9f5aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:23.572363 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-502f3613-8d40-4c82-a24a-d7b018d9f5aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.572751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-502f3613-8d40-4c82-a24a-d7b018d9f5aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.573338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-502f3613-8d40-4c82-a24a-d7b018d9f5aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:23.702177 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9bc57c3e-a99c-466f-a355-e4cbfbb7d1aa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:23.702887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9bc57c3e-a99c-466f-a355-e4cbfbb7d1aa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:23.709956 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9bc57c3e-a99c-466f-a355-e4cbfbb7d1aa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.710448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9bc57c3e-a99c-466f-a355-e4cbfbb7d1aa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.710966 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9bc57c3e-a99c-466f-a355-e4cbfbb7d1aa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:23.711692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9bc57c3e-a99c-466f-a355-e4cbfbb7d1aa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.712294 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9bc57c3e-a99c-466f-a355-e4cbfbb7d1aa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.712822 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9bc57c3e-a99c-466f-a355-e4cbfbb7d1aa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:23.798373 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9bc57c3e-a99c-466f-a355-e4cbfbb7d1aa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:23.807281 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9bc57c3e-a99c-466f-a355-e4cbfbb7d1aa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1303 microversion: 2.1 time: 0.110130 Aug 29 19:10:23.808869 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-502f3613-8d40-4c82-a24a-d7b018d9f5aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:23.820500 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-502f3613-8d40-4c82-a24a-d7b018d9f5aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1367 microversion: 2.1 time: 0.261475 Aug 29 19:10:23.821291 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 202/408] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:23 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:23.822425 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 207/409] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:23 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1303 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:23.829322 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e4cc3e15-2610-4f49-8b5b-719b5329763c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:23.830142 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e4cc3e15-2610-4f49-8b5b-719b5329763c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:23.844056 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4cc3e15-2610-4f49-8b5b-719b5329763c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.845095 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4cc3e15-2610-4f49-8b5b-719b5329763c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.845541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4cc3e15-2610-4f49-8b5b-719b5329763c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:23.846446 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4cc3e15-2610-4f49-8b5b-719b5329763c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.847052 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4cc3e15-2610-4f49-8b5b-719b5329763c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.847528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4cc3e15-2610-4f49-8b5b-719b5329763c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:23.919834 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:23.919834 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:23.923905 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.924402 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.924838 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:23.925548 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:23.926278 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:23.926576 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:24.279711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e4cc3e15-2610-4f49-8b5b-719b5329763c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:24.288084 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e4cc3e15-2610-4f49-8b5b-719b5329763c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1711 microversion: 2.1 time: 0.464396 Aug 29 19:10:24.288653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 208/410] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:23 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1711 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:24.294899 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1314550306", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1804926399", "security_groups": [{"name": "tempest-secgroup-smoke-805233569"}], "block_device_mapping_v2": [{"uuid": "8eb598a0-cad4-4aa5-9b9b-eb1fc5190f11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e57e46be-ed2c-4b43-aa10-cfbdcaee4566"}]}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:24.312077 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:24.323936 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:24.325687 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:24.327694 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-87169b0f-a960-46d9-9202-00917dbc2ab1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1743 microversion: 2.20 time: 0.416877 Aug 29 19:10:24.328402 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 203/411] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:23 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1743 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:10:24.535736 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.network.neutron [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] validate_networks() for [('e57e46be-ed2c-4b43-aa10-cfbdcaee4566', None, None, None, None, None)] {{(pid=115968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:10:24.715195 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-29679c89-7c65-42e0-b93e-0ca3895497f8 req-6bfed072-13d1-438a-a7c9-fadeab581464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a8cf0d-0651-4bf9-9fc2-24a66d1528a0", "name": "network-vif-plugged", "status": "completed", "tag": "7d4b5dab-5d4d-4df3-a064-13f32c7a8555"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:24.725643 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-29679c89-7c65-42e0-b93e-0ca3895497f8 req-6bfed072-13d1-438a-a7c9-fadeab581464 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:24.726242 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-29679c89-7c65-42e0-b93e-0ca3895497f8 req-6bfed072-13d1-438a-a7c9-fadeab581464 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:24.726785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-29679c89-7c65-42e0-b93e-0ca3895497f8 req-6bfed072-13d1-438a-a7c9-fadeab581464 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:24.747324 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-29679c89-7c65-42e0-b93e-0ca3895497f8 req-6bfed072-13d1-438a-a7c9-fadeab581464 service nova] Creating event network-vif-plugged:7d4b5dab-5d4d-4df3-a064-13f32c7a8555 for instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 on hv-cinder-73126 Aug 29 19:10:24.753622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-29679c89-7c65-42e0-b93e-0ca3895497f8 req-6bfed072-13d1-438a-a7c9-fadeab581464 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042641 Aug 29 19:10:24.754321 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 204/412] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:24.832633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-03a3b4f4-715d-43a6-b6fe-0a0c3e7af102 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:24.833388 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-03a3b4f4-715d-43a6-b6fe-0a0c3e7af102 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:24.842133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03a3b4f4-715d-43a6-b6fe-0a0c3e7af102 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:24.842800 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03a3b4f4-715d-43a6-b6fe-0a0c3e7af102 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:24.843263 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03a3b4f4-715d-43a6-b6fe-0a0c3e7af102 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:24.843973 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03a3b4f4-715d-43a6-b6fe-0a0c3e7af102 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:24.844464 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03a3b4f4-715d-43a6-b6fe-0a0c3e7af102 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:24.844892 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03a3b4f4-715d-43a6-b6fe-0a0c3e7af102 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:24.939011 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-03a3b4f4-715d-43a6-b6fe-0a0c3e7af102 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:24.947483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-03a3b4f4-715d-43a6-b6fe-0a0c3e7af102 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1303 microversion: 2.1 time: 0.120574 Aug 29 19:10:24.956021 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 205/413] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:24 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:24.956021 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9d3ce079-1980-49c8-aab8-c4359f8fbfa8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:24.956021 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9d3ce079-1980-49c8-aab8-c4359f8fbfa8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:24.963999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d3ce079-1980-49c8-aab8-c4359f8fbfa8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:24.963999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d3ce079-1980-49c8-aab8-c4359f8fbfa8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:24.963999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d3ce079-1980-49c8-aab8-c4359f8fbfa8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:24.963999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d3ce079-1980-49c8-aab8-c4359f8fbfa8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:24.964434 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d3ce079-1980-49c8-aab8-c4359f8fbfa8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:24.964434 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d3ce079-1980-49c8-aab8-c4359f8fbfa8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.368093 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9d3ce079-1980-49c8-aab8-c4359f8fbfa8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:25.377786 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9d3ce079-1980-49c8-aab8-c4359f8fbfa8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1367 microversion: 2.1 time: 0.428512 Aug 29 19:10:25.378606 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 206/414] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:24 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1367 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:25.382907 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2a5a977f-7253-4849-b0ff-1df99d90de96 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:25.383837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2a5a977f-7253-4849-b0ff-1df99d90de96 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:25.390802 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Flavor limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:10:25.391643 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Image limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:10:25.392468 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Flavor pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:10:25.393125 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Image pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:10:25.394901 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:10:25.397235 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a5a977f-7253-4849-b0ff-1df99d90de96 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.397742 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a5a977f-7253-4849-b0ff-1df99d90de96 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.398206 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a5a977f-7253-4849-b0ff-1df99d90de96 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.398986 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a5a977f-7253-4849-b0ff-1df99d90de96 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.400244 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a5a977f-7253-4849-b0ff-1df99d90de96 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.400689 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a5a977f-7253-4849-b0ff-1df99d90de96 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.408526 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:25.411930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.412945 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.413613 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.414670 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.416017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.417157 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.442103 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Getting quotas for project 6a4d940594f542808602c7260993f85f. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:10:25.456439 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Getting quotas for user 8f1c0b2189a041fdb8dbe2a0290ffac8 and project 6a4d940594f542808602c7260993f85f. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:10:25.543190 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Going to run 1 instances... {{(pid=115968) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:10:25.545308 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8eb598a0-cad4-4aa5-9b9b-eb1fc5190f11',volume_size=None,volume_type=None)] {{(pid=115968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:10:25.553024 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2a5a977f-7253-4849-b0ff-1df99d90de96 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:25.562049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2a5a977f-7253-4849-b0ff-1df99d90de96 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1711 microversion: 2.1 time: 0.182615 Aug 29 19:10:25.562639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 207/415] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:25 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1711 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:25.567120 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:25.567731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:25.575102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.575551 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.575990 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.576777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.577240 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.577664 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.699631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8c3d00f2-12af-44fa-8b0c-dee349da2b3e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.409626 Aug 29 19:10:25.705869 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 209/416] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:10:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:10:25.710580 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9231104f-bae1-402d-b022-d41f2945635b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:25.712938 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9231104f-bae1-402d-b022-d41f2945635b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:25.724423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:25.740129 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:25.742248 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:25.744683 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3c96535a-61fc-4222-ae14-2cf0a19dd2cc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1743 microversion: 2.20 time: 0.181078 Aug 29 19:10:25.745760 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 208/417] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:25 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:25.777772 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9231104f-bae1-402d-b022-d41f2945635b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:25.786289 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9231104f-bae1-402d-b022-d41f2945635b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1095 microversion: 2.1 time: 0.079164 Aug 29 19:10:25.795109 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 210/418] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:25 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:25.968205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5e3e835b-3cde-4498-8f43-2a2f24edcec0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:25.968856 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5e3e835b-3cde-4498-8f43-2a2f24edcec0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:25.974643 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e3e835b-3cde-4498-8f43-2a2f24edcec0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.975381 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e3e835b-3cde-4498-8f43-2a2f24edcec0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.975854 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e3e835b-3cde-4498-8f43-2a2f24edcec0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:25.976555 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e3e835b-3cde-4498-8f43-2a2f24edcec0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:25.977015 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e3e835b-3cde-4498-8f43-2a2f24edcec0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:25.977440 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e3e835b-3cde-4498-8f43-2a2f24edcec0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:26.199416 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5e3e835b-3cde-4498-8f43-2a2f24edcec0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:26.206997 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5e3e835b-3cde-4498-8f43-2a2f24edcec0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.242724 Aug 29 19:10:26.207598 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 209/419] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:25 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:26.398926 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-bb5ccc13-0232-4821-9197-b27ef27d8506 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:26.399615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-bb5ccc13-0232-4821-9197-b27ef27d8506 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:26.405927 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bb5ccc13-0232-4821-9197-b27ef27d8506 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:26.406424 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bb5ccc13-0232-4821-9197-b27ef27d8506 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:26.406861 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bb5ccc13-0232-4821-9197-b27ef27d8506 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:26.407591 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bb5ccc13-0232-4821-9197-b27ef27d8506 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:26.408049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bb5ccc13-0232-4821-9197-b27ef27d8506 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:26.408477 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bb5ccc13-0232-4821-9197-b27ef27d8506 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:26.457631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-fe65e889-f22c-4e20-9067-b146f48d6022 req-ec5db689-3129-4607-a1a8-a20812953773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0236f3d8-fe14-4ea6-a952-ad43a97260aa", "tag": "f5ea5791-6357-48d5-bdaa-4b91eacc1a22"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:26.469095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-fe65e889-f22c-4e20-9067-b146f48d6022 req-ec5db689-3129-4607-a1a8-a20812953773 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:26.469686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-fe65e889-f22c-4e20-9067-b146f48d6022 req-ec5db689-3129-4607-a1a8-a20812953773 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:26.470368 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-fe65e889-f22c-4e20-9067-b146f48d6022 req-ec5db689-3129-4607-a1a8-a20812953773 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:26.483909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-fe65e889-f22c-4e20-9067-b146f48d6022 req-ec5db689-3129-4607-a1a8-a20812953773 service nova] Creating event network-changed:f5ea5791-6357-48d5-bdaa-4b91eacc1a22 for instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa on hv-cinder-73126 Aug 29 19:10:26.488823 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-fe65e889-f22c-4e20-9067-b146f48d6022 req-ec5db689-3129-4607-a1a8-a20812953773 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035027 Aug 29 19:10:26.489515 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 210/420] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:10:26.585692 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9ac877e2-7d7d-421c-acc5-931891b0465e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:26.586394 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9ac877e2-7d7d-421c-acc5-931891b0465e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:26.593693 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ac877e2-7d7d-421c-acc5-931891b0465e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:26.594190 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ac877e2-7d7d-421c-acc5-931891b0465e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:26.594629 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ac877e2-7d7d-421c-acc5-931891b0465e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:26.595371 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ac877e2-7d7d-421c-acc5-931891b0465e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:26.596019 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ac877e2-7d7d-421c-acc5-931891b0465e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:26.596452 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ac877e2-7d7d-421c-acc5-931891b0465e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:26.919461 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-bb5ccc13-0232-4821-9197-b27ef27d8506 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:26.927166 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-bb5ccc13-0232-4821-9197-b27ef27d8506 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1367 microversion: 2.1 time: 0.532137 Aug 29 19:10:26.927858 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 211/421] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:26 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1367 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:26.933619 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:26.934300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:26.940256 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:26.940804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:26.941460 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:26.942213 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:26.942729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:26.943291 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:26.946998 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9ac877e2-7d7d-421c-acc5-931891b0465e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:26.955037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9ac877e2-7d7d-421c-acc5-931891b0465e tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1715 microversion: 2.1 time: 0.373483 Aug 29 19:10:26.955649 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 211/422] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:26 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1715 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:26.960123 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0c1cfa5f-db4b-4219-a93f-04278bacc6fd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:26.960723 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0c1cfa5f-db4b-4219-a93f-04278bacc6fd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:26.966386 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0c1cfa5f-db4b-4219-a93f-04278bacc6fd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:26.966875 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0c1cfa5f-db4b-4219-a93f-04278bacc6fd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:26.967543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0c1cfa5f-db4b-4219-a93f-04278bacc6fd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:26.968243 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0c1cfa5f-db4b-4219-a93f-04278bacc6fd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:26.968769 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0c1cfa5f-db4b-4219-a93f-04278bacc6fd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:26.969204 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0c1cfa5f-db4b-4219-a93f-04278bacc6fd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:27.045984 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0c1cfa5f-db4b-4219-a93f-04278bacc6fd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:27.054225 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0c1cfa5f-db4b-4219-a93f-04278bacc6fd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1145 microversion: 2.1 time: 0.097596 Aug 29 19:10:27.054922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 212/423] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:26 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1145 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:27.109912 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:27.117954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:27.120173 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:27.121338 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-67db2113-5bab-4543-87ff-4fb6a19abd58 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1743 microversion: 2.20 time: 0.192443 Aug 29 19:10:27.122278 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 212/424] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:26 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:27.227354 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fe75a3d9-c172-4735-9007-24ca86a0bf9f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:27.228543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fe75a3d9-c172-4735-9007-24ca86a0bf9f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:27.234636 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe75a3d9-c172-4735-9007-24ca86a0bf9f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:27.235145 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe75a3d9-c172-4735-9007-24ca86a0bf9f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:27.235582 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe75a3d9-c172-4735-9007-24ca86a0bf9f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:27.236262 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe75a3d9-c172-4735-9007-24ca86a0bf9f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:27.236713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe75a3d9-c172-4735-9007-24ca86a0bf9f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:27.237131 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe75a3d9-c172-4735-9007-24ca86a0bf9f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:27.416041 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fe75a3d9-c172-4735-9007-24ca86a0bf9f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:27.419642 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fe75a3d9-c172-4735-9007-24ca86a0bf9f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.196024 Aug 29 19:10:27.420403 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 213/425] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:27 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:27.948613 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-361509fa-fdad-4f0d-85c8-6965ffeee161 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:27.949219 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-361509fa-fdad-4f0d-85c8-6965ffeee161 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:27.955546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-361509fa-fdad-4f0d-85c8-6965ffeee161 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:27.956020 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-361509fa-fdad-4f0d-85c8-6965ffeee161 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:27.956446 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-361509fa-fdad-4f0d-85c8-6965ffeee161 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:27.957125 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-361509fa-fdad-4f0d-85c8-6965ffeee161 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:27.957568 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-361509fa-fdad-4f0d-85c8-6965ffeee161 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:27.957983 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-361509fa-fdad-4f0d-85c8-6965ffeee161 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.076522 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-600ed1f6-6c7b-4637-8ab4-0a576b8304e8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:28.077132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-600ed1f6-6c7b-4637-8ab4-0a576b8304e8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:28.083857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-600ed1f6-6c7b-4637-8ab4-0a576b8304e8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:28.084442 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-600ed1f6-6c7b-4637-8ab4-0a576b8304e8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:28.084945 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-600ed1f6-6c7b-4637-8ab4-0a576b8304e8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.085712 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-600ed1f6-6c7b-4637-8ab4-0a576b8304e8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:28.086397 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-600ed1f6-6c7b-4637-8ab4-0a576b8304e8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:28.087016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-600ed1f6-6c7b-4637-8ab4-0a576b8304e8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.093346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-361509fa-fdad-4f0d-85c8-6965ffeee161 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:28.104080 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-361509fa-fdad-4f0d-85c8-6965ffeee161 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1367 microversion: 2.1 time: 0.158880 Aug 29 19:10:28.116613 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 213/426] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:27 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:28.145746 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:28.146495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:28.154100 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:28.154679 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:28.155241 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.155944 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:28.156390 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:28.156914 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.158450 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-600ed1f6-6c7b-4637-8ab4-0a576b8304e8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:28.169073 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-600ed1f6-6c7b-4637-8ab4-0a576b8304e8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1193 microversion: 2.1 time: 0.097122 Aug 29 19:10:28.172606 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 214/427] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:28 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:28.292589 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:28.301046 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:28.302600 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:28.303846 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3e044733-980e-47af-8a15-b47ac0fc3116 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1743 microversion: 2.20 time: 0.162720 Aug 29 19:10:28.304407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 214/428] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:28 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:10:28.440242 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e1430c25-b74d-4d9a-b411-4b4f9e2f2f53 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:28.440860 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e1430c25-b74d-4d9a-b411-4b4f9e2f2f53 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:28.446662 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1430c25-b74d-4d9a-b411-4b4f9e2f2f53 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:28.447181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1430c25-b74d-4d9a-b411-4b4f9e2f2f53 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:28.447621 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1430c25-b74d-4d9a-b411-4b4f9e2f2f53 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.448320 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1430c25-b74d-4d9a-b411-4b4f9e2f2f53 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:28.448777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1430c25-b74d-4d9a-b411-4b4f9e2f2f53 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:28.449198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1430c25-b74d-4d9a-b411-4b4f9e2f2f53 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.578028 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e1430c25-b74d-4d9a-b411-4b4f9e2f2f53 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:28.585884 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e1430c25-b74d-4d9a-b411-4b4f9e2f2f53 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.149285 Aug 29 19:10:28.586308 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 215/429] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:28 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:28.691091 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-a81b0967-7b5a-4e2e-bb92-41e70de2b22f req-1d2e7c45-b3ce-4beb-b01a-551280ea3446 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4696f764-f3e7-482f-b94e-549896198ddf", "name": "network-vif-plugged", "status": "completed", "tag": "90bec49f-36b1-4027-8fc3-86cd4d15e3f4"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:28.701031 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-a81b0967-7b5a-4e2e-bb92-41e70de2b22f req-1d2e7c45-b3ce-4beb-b01a-551280ea3446 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:28.701502 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-a81b0967-7b5a-4e2e-bb92-41e70de2b22f req-1d2e7c45-b3ce-4beb-b01a-551280ea3446 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:28.701931 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-a81b0967-7b5a-4e2e-bb92-41e70de2b22f req-1d2e7c45-b3ce-4beb-b01a-551280ea3446 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:28.714843 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-a81b0967-7b5a-4e2e-bb92-41e70de2b22f req-1d2e7c45-b3ce-4beb-b01a-551280ea3446 service nova] Creating event network-vif-plugged:90bec49f-36b1-4027-8fc3-86cd4d15e3f4 for instance 4696f764-f3e7-482f-b94e-549896198ddf on hv-cinder-73126 Aug 29 19:10:28.720377 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-a81b0967-7b5a-4e2e-bb92-41e70de2b22f req-1d2e7c45-b3ce-4beb-b01a-551280ea3446 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032897 Aug 29 19:10:28.721151 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 215/430] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:29.125970 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-95b9716b-7e54-435d-b3ac-9a45b2564749 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:29.126627 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-95b9716b-7e54-435d-b3ac-9a45b2564749 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:29.132975 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95b9716b-7e54-435d-b3ac-9a45b2564749 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:29.133462 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95b9716b-7e54-435d-b3ac-9a45b2564749 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:29.133999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95b9716b-7e54-435d-b3ac-9a45b2564749 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:29.134839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95b9716b-7e54-435d-b3ac-9a45b2564749 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:29.135729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95b9716b-7e54-435d-b3ac-9a45b2564749 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:29.138362 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-95b9716b-7e54-435d-b3ac-9a45b2564749 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:29.192963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-bf1c4a8b-40b9-4f24-811e-a40f7e9a6fa1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:29.193759 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-bf1c4a8b-40b9-4f24-811e-a40f7e9a6fa1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:29.201432 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bf1c4a8b-40b9-4f24-811e-a40f7e9a6fa1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:29.202047 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bf1c4a8b-40b9-4f24-811e-a40f7e9a6fa1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:29.202598 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bf1c4a8b-40b9-4f24-811e-a40f7e9a6fa1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:29.203437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bf1c4a8b-40b9-4f24-811e-a40f7e9a6fa1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:29.203989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bf1c4a8b-40b9-4f24-811e-a40f7e9a6fa1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:29.204507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bf1c4a8b-40b9-4f24-811e-a40f7e9a6fa1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:29.296589 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-bf1c4a8b-40b9-4f24-811e-a40f7e9a6fa1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:29.304726 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-bf1c4a8b-40b9-4f24-811e-a40f7e9a6fa1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1193 microversion: 2.1 time: 0.117432 Aug 29 19:10:29.306045 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 216/431] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:29 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1193 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:29.330084 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:29.330684 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:29.336614 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:29.337096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:29.337524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:29.338268 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:29.338654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:29.339749 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:29.343122 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-95b9716b-7e54-435d-b3ac-9a45b2564749 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:29.350827 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-95b9716b-7e54-435d-b3ac-9a45b2564749 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1558 microversion: 2.1 time: 0.229307 Aug 29 19:10:29.351417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 216/432] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:29 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1558 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:29.370869 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f2bd9708-a9f5-4ca4-a381-2e9922667f50 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:29.371387 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f2bd9708-a9f5-4ca4-a381-2e9922667f50 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:29.377389 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2bd9708-a9f5-4ca4-a381-2e9922667f50 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:29.377892 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2bd9708-a9f5-4ca4-a381-2e9922667f50 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:29.378329 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2bd9708-a9f5-4ca4-a381-2e9922667f50 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:29.379020 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2bd9708-a9f5-4ca4-a381-2e9922667f50 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:29.379500 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2bd9708-a9f5-4ca4-a381-2e9922667f50 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:29.379946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f2bd9708-a9f5-4ca4-a381-2e9922667f50 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:29.497925 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f2bd9708-a9f5-4ca4-a381-2e9922667f50 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130995 Aug 29 19:10:29.498697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 217/433] 10.222.0.94 () {58 vars in 1275 bytes} [Mon Aug 29 19:10:29 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:10:29.523166 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:29.531813 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:29.533264 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:29.534681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-17935717-6a1f-4b99-96b9-c171c937cc3b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.208457 Aug 29 19:10:29.542812 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 217/434] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:29 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:10:29.606170 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-85328a85-76db-40c3-94e9-86d54e63bbf2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:29.606705 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-85328a85-76db-40c3-94e9-86d54e63bbf2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:29.613132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-85328a85-76db-40c3-94e9-86d54e63bbf2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:29.613614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-85328a85-76db-40c3-94e9-86d54e63bbf2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:29.614074 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-85328a85-76db-40c3-94e9-86d54e63bbf2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:29.614765 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-85328a85-76db-40c3-94e9-86d54e63bbf2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:29.615254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-85328a85-76db-40c3-94e9-86d54e63bbf2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:29.615678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-85328a85-76db-40c3-94e9-86d54e63bbf2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:29.942421 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-85328a85-76db-40c3-94e9-86d54e63bbf2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:29.961083 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-85328a85-76db-40c3-94e9-86d54e63bbf2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.355296 Aug 29 19:10:29.963680 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 218/435] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:29 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:30.326746 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7d634506-359f-48f1-8b4c-5c8a9faf2324 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:30.327972 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7d634506-359f-48f1-8b4c-5c8a9faf2324 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:30.335789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d634506-359f-48f1-8b4c-5c8a9faf2324 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:30.342408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d634506-359f-48f1-8b4c-5c8a9faf2324 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:30.343155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d634506-359f-48f1-8b4c-5c8a9faf2324 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:30.344070 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d634506-359f-48f1-8b4c-5c8a9faf2324 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:30.344676 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d634506-359f-48f1-8b4c-5c8a9faf2324 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:30.345247 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d634506-359f-48f1-8b4c-5c8a9faf2324 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:30.443751 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7d634506-359f-48f1-8b4c-5c8a9faf2324 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:30.458500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7d634506-359f-48f1-8b4c-5c8a9faf2324 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1211 microversion: 2.1 time: 0.136479 Aug 29 19:10:30.459099 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 218/436] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:30 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1211 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:30.559863 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:30.561631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:30.568431 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:30.569565 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:30.570164 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:30.571100 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:30.572361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:30.572947 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:30.756497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:30.765702 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:30.767998 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:30.769621 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-616affc7-8c09-4182-991d-febc8b43e8a8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.214654 Aug 29 19:10:30.770371 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 219/437] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:30 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:30.851742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-1eebe545-294d-469a-825d-318633be94a3 req-ab13737d-3373-4c22-a088-9358c04fac51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43a8cf0d-0651-4bf9-9fc2-24a66d1528a0", "tag": "7d4b5dab-5d4d-4df3-a064-13f32c7a8555"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:30.868149 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-1eebe545-294d-469a-825d-318633be94a3 req-ab13737d-3373-4c22-a088-9358c04fac51 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:30.868917 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-1eebe545-294d-469a-825d-318633be94a3 req-ab13737d-3373-4c22-a088-9358c04fac51 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:30.869506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-1eebe545-294d-469a-825d-318633be94a3 req-ab13737d-3373-4c22-a088-9358c04fac51 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:30.884707 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-1eebe545-294d-469a-825d-318633be94a3 req-ab13737d-3373-4c22-a088-9358c04fac51 service nova] Creating event network-changed:7d4b5dab-5d4d-4df3-a064-13f32c7a8555 for instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 on hv-cinder-73126 Aug 29 19:10:30.890748 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-1eebe545-294d-469a-825d-318633be94a3 req-ab13737d-3373-4c22-a088-9358c04fac51 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042842 Aug 29 19:10:30.891718 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 219/438] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:30.990226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-df7b7ce0-8b43-40a5-9f86-2b026f4608ea tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:30.992125 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-df7b7ce0-8b43-40a5-9f86-2b026f4608ea tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:31.002807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df7b7ce0-8b43-40a5-9f86-2b026f4608ea tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:31.007181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df7b7ce0-8b43-40a5-9f86-2b026f4608ea tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:31.008215 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df7b7ce0-8b43-40a5-9f86-2b026f4608ea tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:31.009275 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df7b7ce0-8b43-40a5-9f86-2b026f4608ea tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:31.010156 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df7b7ce0-8b43-40a5-9f86-2b026f4608ea tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:31.011571 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df7b7ce0-8b43-40a5-9f86-2b026f4608ea tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:31.202544 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-df7b7ce0-8b43-40a5-9f86-2b026f4608ea tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:31.210916 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-df7b7ce0-8b43-40a5-9f86-2b026f4608ea tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.231649 Aug 29 19:10:31.212786 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 220/439] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:30 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:31.486681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9b65e8f4-d3a8-4c99-bad1-9eb219f71feb tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:31.490285 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9b65e8f4-d3a8-4c99-bad1-9eb219f71feb tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:31.533752 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9b65e8f4-d3a8-4c99-bad1-9eb219f71feb tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:31.535339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9b65e8f4-d3a8-4c99-bad1-9eb219f71feb tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:31.536017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9b65e8f4-d3a8-4c99-bad1-9eb219f71feb tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:31.536925 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9b65e8f4-d3a8-4c99-bad1-9eb219f71feb tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:31.537553 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9b65e8f4-d3a8-4c99-bad1-9eb219f71feb tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:31.538220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9b65e8f4-d3a8-4c99-bad1-9eb219f71feb tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:31.684759 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9b65e8f4-d3a8-4c99-bad1-9eb219f71feb tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:31.693692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9b65e8f4-d3a8-4c99-bad1-9eb219f71feb tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1211 microversion: 2.1 time: 0.215345 Aug 29 19:10:31.694653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 220/440] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:31 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1211 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:31.794983 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:31.795729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:31.801422 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:31.803045 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:31.803857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:31.804382 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:31.805155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:31.805694 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:31.806186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:31.987856 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:31.999920 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:32.003025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:32.004181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-720c0e3b-b8b4-4712-9121-83df696180eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.213290 Aug 29 19:10:32.005909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 221/441] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:31 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:32.238248 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2fa6a6fb-c70e-4a23-98fc-f5ea9439491e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:32.239209 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2fa6a6fb-c70e-4a23-98fc-f5ea9439491e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:32.255063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2fa6a6fb-c70e-4a23-98fc-f5ea9439491e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:32.258333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2fa6a6fb-c70e-4a23-98fc-f5ea9439491e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:32.259046 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2fa6a6fb-c70e-4a23-98fc-f5ea9439491e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:32.263450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2fa6a6fb-c70e-4a23-98fc-f5ea9439491e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:32.264171 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2fa6a6fb-c70e-4a23-98fc-f5ea9439491e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:32.267459 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2fa6a6fb-c70e-4a23-98fc-f5ea9439491e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:32.496063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2fa6a6fb-c70e-4a23-98fc-f5ea9439491e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:32.506824 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2fa6a6fb-c70e-4a23-98fc-f5ea9439491e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.273761 Aug 29 19:10:32.507953 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 221/442] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:32 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:32.716430 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9b342b6d-21b7-41f6-ac8b-8fa67ea62314 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:32.717593 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9b342b6d-21b7-41f6-ac8b-8fa67ea62314 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:32.730710 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b342b6d-21b7-41f6-ac8b-8fa67ea62314 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:32.731625 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b342b6d-21b7-41f6-ac8b-8fa67ea62314 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:32.732182 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b342b6d-21b7-41f6-ac8b-8fa67ea62314 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:32.732973 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b342b6d-21b7-41f6-ac8b-8fa67ea62314 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:32.733638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b342b6d-21b7-41f6-ac8b-8fa67ea62314 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:32.734148 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b342b6d-21b7-41f6-ac8b-8fa67ea62314 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:32.849555 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9b342b6d-21b7-41f6-ac8b-8fa67ea62314 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:32.862132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9b342b6d-21b7-41f6-ac8b-8fa67ea62314 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1211 microversion: 2.1 time: 0.151304 Aug 29 19:10:32.863558 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 222/443] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:32 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1211 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:33.029847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:33.030494 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:33.037761 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:33.038241 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:33.038667 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:33.039445 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:33.039935 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:33.040354 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:33.434693 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:33.450896 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:33.453434 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:33.455522 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0d6fd44a-5abb-4214-9a00-83d1124552cf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.430315 Aug 29 19:10:33.457235 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 222/444] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:33 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:33.528788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6695424d-5ffd-4ac2-b5e1-62c87658a3dc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:33.529888 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6695424d-5ffd-4ac2-b5e1-62c87658a3dc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:33.537528 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6695424d-5ffd-4ac2-b5e1-62c87658a3dc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:33.556751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6695424d-5ffd-4ac2-b5e1-62c87658a3dc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:33.558309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6695424d-5ffd-4ac2-b5e1-62c87658a3dc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:33.559892 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6695424d-5ffd-4ac2-b5e1-62c87658a3dc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:33.560595 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6695424d-5ffd-4ac2-b5e1-62c87658a3dc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:33.561256 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6695424d-5ffd-4ac2-b5e1-62c87658a3dc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:33.883387 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fda7e080-4530-4f5f-948d-4f1da57e2bdd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:33.885730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fda7e080-4530-4f5f-948d-4f1da57e2bdd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:33.898480 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fda7e080-4530-4f5f-948d-4f1da57e2bdd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:33.898976 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fda7e080-4530-4f5f-948d-4f1da57e2bdd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:33.899641 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fda7e080-4530-4f5f-948d-4f1da57e2bdd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:33.900516 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fda7e080-4530-4f5f-948d-4f1da57e2bdd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:33.901274 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fda7e080-4530-4f5f-948d-4f1da57e2bdd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:33.902641 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fda7e080-4530-4f5f-948d-4f1da57e2bdd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:33.978297 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6695424d-5ffd-4ac2-b5e1-62c87658a3dc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:33.986114 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6695424d-5ffd-4ac2-b5e1-62c87658a3dc tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.461445 Aug 29 19:10:33.986686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 223/445] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:33 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:34.242472 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fda7e080-4530-4f5f-948d-4f1da57e2bdd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:34.247595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:34.252654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fda7e080-4530-4f5f-948d-4f1da57e2bdd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1278 microversion: 2.1 time: 0.373845 Aug 29 19:10:34.253232 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 223/446] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:33 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1278 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:34.483437 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:34.484677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:34.506028 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:34.509098 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:34.510816 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:34.515644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:34.517244 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:34.518761 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:34.810260 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:34.814727 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:34.835407 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:34.837170 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:34.838642 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-517fd213-6906-48bf-8e11-e0092223ab76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.359597 Aug 29 19:10:34.844736 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 224/447] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:34 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:35.008852 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ac071970-bc5b-4966-beb9-105c2c5d6b8d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:35.011248 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ac071970-bc5b-4966-beb9-105c2c5d6b8d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:35.030534 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac071970-bc5b-4966-beb9-105c2c5d6b8d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:35.031183 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac071970-bc5b-4966-beb9-105c2c5d6b8d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:35.032989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac071970-bc5b-4966-beb9-105c2c5d6b8d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:35.033973 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac071970-bc5b-4966-beb9-105c2c5d6b8d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:35.034877 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac071970-bc5b-4966-beb9-105c2c5d6b8d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:35.035602 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac071970-bc5b-4966-beb9-105c2c5d6b8d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:35.278728 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-57118ca0-aa2c-4464-a9a9-135a8e1b382a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:35.279994 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-57118ca0-aa2c-4464-a9a9-135a8e1b382a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:35.287614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57118ca0-aa2c-4464-a9a9-135a8e1b382a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:35.288193 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57118ca0-aa2c-4464-a9a9-135a8e1b382a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:35.288555 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57118ca0-aa2c-4464-a9a9-135a8e1b382a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:35.289266 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57118ca0-aa2c-4464-a9a9-135a8e1b382a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:35.289727 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57118ca0-aa2c-4464-a9a9-135a8e1b382a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:35.290186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57118ca0-aa2c-4464-a9a9-135a8e1b382a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:35.329807 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ac071970-bc5b-4966-beb9-105c2c5d6b8d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:35.340124 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ac071970-bc5b-4966-beb9-105c2c5d6b8d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.333964 Aug 29 19:10:35.341665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 224/448] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:35 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:35.358454 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-c70d8656-8dbf-467b-9c60-21dd80066903 req-3435e27f-b8be-4c6f-96dd-3bcf21bf5400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52e65bd-038e-4fc8-807e-4e4ce60c8db7", "tag": "32fdb103-82cb-4537-9dfe-6532b2639a2a"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:35.377507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-c70d8656-8dbf-467b-9c60-21dd80066903 req-3435e27f-b8be-4c6f-96dd-3bcf21bf5400 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:35.378483 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-c70d8656-8dbf-467b-9c60-21dd80066903 req-3435e27f-b8be-4c6f-96dd-3bcf21bf5400 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:35.379179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-c70d8656-8dbf-467b-9c60-21dd80066903 req-3435e27f-b8be-4c6f-96dd-3bcf21bf5400 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:35.395938 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-c70d8656-8dbf-467b-9c60-21dd80066903 req-3435e27f-b8be-4c6f-96dd-3bcf21bf5400 service nova] Creating event network-changed:32fdb103-82cb-4537-9dfe-6532b2639a2a for instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 on hv-cinder-73126 Aug 29 19:10:35.401641 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-c70d8656-8dbf-467b-9c60-21dd80066903 req-3435e27f-b8be-4c6f-96dd-3bcf21bf5400 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058474 Aug 29 19:10:35.402649 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 225/449] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:35.547027 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-57118ca0-aa2c-4464-a9a9-135a8e1b382a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:35.556647 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-57118ca0-aa2c-4464-a9a9-135a8e1b382a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.283271 Aug 29 19:10:35.567895 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 225/450] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:35 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:35.868276 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=4 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:35.869495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=20 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:35.874406 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:35.875363 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:35.884295 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:35.884789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:35.885225 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:35.886459 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:35.887115 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:35.887625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:36.069943 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:36.081988 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:36.082217 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-330242748", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1218624179", "security_groups": [{"name": "tempest-secgroup-smoke-1095720548"}], "networks": [{"uuid": "c577f8dd-232c-46d1-8dca-d9595c50b55d"}], "block_device_mapping_v2": [{"uuid": "a8974980-5562-45d1-ab74-b7d802914956", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:36.084098 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:36.085481 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-272ea139-585b-43f2-82cb-10583f5eff84 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.218199 Aug 29 19:10:36.091935 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 226/451] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:35 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:36.213888 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] validate_networks() for [('c577f8dd-232c-46d1-8dca-d9595c50b55d', None, None, None, None, None)] {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:10:36.361729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3c7c431a-a668-412c-9328-62008320cc0f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:36.362665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3c7c431a-a668-412c-9328-62008320cc0f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:36.370930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7c431a-a668-412c-9328-62008320cc0f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:36.371777 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7c431a-a668-412c-9328-62008320cc0f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:36.372393 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7c431a-a668-412c-9328-62008320cc0f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:36.373932 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7c431a-a668-412c-9328-62008320cc0f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:36.374422 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7c431a-a668-412c-9328-62008320cc0f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:36.374848 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7c431a-a668-412c-9328-62008320cc0f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:36.598624 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3c7c431a-a668-412c-9328-62008320cc0f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:36.608673 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3c7c431a-a668-412c-9328-62008320cc0f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.250751 Aug 29 19:10:36.615935 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 227/452] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:36 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:36.623962 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e744ad3b-4a6e-4853-b46f-49b69fd47d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:36.623962 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e744ad3b-4a6e-4853-b46f-49b69fd47d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:36.631390 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e744ad3b-4a6e-4853-b46f-49b69fd47d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:36.631901 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e744ad3b-4a6e-4853-b46f-49b69fd47d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:36.632344 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e744ad3b-4a6e-4853-b46f-49b69fd47d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:36.633042 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e744ad3b-4a6e-4853-b46f-49b69fd47d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:36.633517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e744ad3b-4a6e-4853-b46f-49b69fd47d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:36.633939 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e744ad3b-4a6e-4853-b46f-49b69fd47d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:36.809238 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:10:36.810068 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:10:36.810652 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:10:36.811200 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:10:36.811856 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:10:36.823969 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:36.825060 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:36.825738 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:36.826728 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:36.827441 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:36.829286 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:36.874372 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e744ad3b-4a6e-4853-b46f-49b69fd47d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:36.884065 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e744ad3b-4a6e-4853-b46f-49b69fd47d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.266801 Aug 29 19:10:36.896616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 228/453] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:36 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:36.907806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Getting quotas for project f0f4bcf841c942a9928f5b343b5fb8bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:10:36.913565 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Getting quotas for user 82fb5d585b5d460bb258f929057a4093 and project f0f4bcf841c942a9928f5b343b5fb8bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:10:36.978199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:10:36.981283 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a8974980-5562-45d1-ab74-b7d802914956',volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:10:37.111549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:37.112129 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:37.114430 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:37.119823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:37.120955 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:37.121575 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:37.122331 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:37.122964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:37.123555 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:37.193286 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7deaeeca-944c-43fc-a784-d79059997caa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.115827 Aug 29 19:10:37.203859 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 226/454] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:10:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:10:37.208798 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-87e3d44a-7a8d-4624-824d-a807a264e0ef tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:37.209686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-87e3d44a-7a8d-4624-824d-a807a264e0ef tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:37.300869 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-87e3d44a-7a8d-4624-824d-a807a264e0ef tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:37.310368 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-87e3d44a-7a8d-4624-824d-a807a264e0ef tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1088 microversion: 2.1 time: 0.107540 Aug 29 19:10:37.313234 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 227/455] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:37 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1088 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:37.330336 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:37.340338 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:37.342778 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:37.344814 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-21179fe5-0baf-440d-ba5d-99e0219bc289 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.237423 Aug 29 19:10:37.346859 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 229/456] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:37 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:37.630258 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c6e109eb-9898-4460-a8ca-78699828f1e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:37.631130 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c6e109eb-9898-4460-a8ca-78699828f1e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:37.641766 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c6e109eb-9898-4460-a8ca-78699828f1e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:37.642417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c6e109eb-9898-4460-a8ca-78699828f1e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:37.642863 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c6e109eb-9898-4460-a8ca-78699828f1e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:37.643597 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c6e109eb-9898-4460-a8ca-78699828f1e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:37.644237 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c6e109eb-9898-4460-a8ca-78699828f1e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:37.645008 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c6e109eb-9898-4460-a8ca-78699828f1e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:37.806156 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c6e109eb-9898-4460-a8ca-78699828f1e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:37.816223 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c6e109eb-9898-4460-a8ca-78699828f1e8 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.189982 Aug 29 19:10:37.816934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 228/457] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:37 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:37.906753 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5b543cff-2215-45d4-9525-201f3f48b8c2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:37.909117 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5b543cff-2215-45d4-9525-201f3f48b8c2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:37.914868 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b543cff-2215-45d4-9525-201f3f48b8c2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:37.915772 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b543cff-2215-45d4-9525-201f3f48b8c2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:37.916418 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b543cff-2215-45d4-9525-201f3f48b8c2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:37.917166 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b543cff-2215-45d4-9525-201f3f48b8c2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:37.918567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b543cff-2215-45d4-9525-201f3f48b8c2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:37.919005 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5b543cff-2215-45d4-9525-201f3f48b8c2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:38.094876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5b543cff-2215-45d4-9525-201f3f48b8c2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:38.105941 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5b543cff-2215-45d4-9525-201f3f48b8c2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.204028 Aug 29 19:10:38.106924 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 230/458] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:37 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:38.332326 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cd820273-63bb-4566-b5af-de1539992a34 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:38.333382 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cd820273-63bb-4566-b5af-de1539992a34 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:38.341782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd820273-63bb-4566-b5af-de1539992a34 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:38.342751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd820273-63bb-4566-b5af-de1539992a34 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:38.343433 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd820273-63bb-4566-b5af-de1539992a34 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:38.344495 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd820273-63bb-4566-b5af-de1539992a34 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:38.345187 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd820273-63bb-4566-b5af-de1539992a34 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:38.346160 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd820273-63bb-4566-b5af-de1539992a34 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:38.372034 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:38.373283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:38.382223 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:38.383515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:38.385079 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:38.386283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:38.387160 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:38.387805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:38.627529 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cd820273-63bb-4566-b5af-de1539992a34 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:38.640493 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cd820273-63bb-4566-b5af-de1539992a34 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1130 microversion: 2.1 time: 0.311785 Aug 29 19:10:38.641633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 229/459] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:38 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1130 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:38.734431 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:38.747657 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:38.749963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:38.751593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e14dde16-1713-4fa0-b944-ae162add2ec9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.386476 Aug 29 19:10:38.752348 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 231/460] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:38 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:38.842560 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3574f039-7d47-4614-bc05-68dfb8e2ce50 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:38.844351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3574f039-7d47-4614-bc05-68dfb8e2ce50 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:38.850542 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3574f039-7d47-4614-bc05-68dfb8e2ce50 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:38.851266 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3574f039-7d47-4614-bc05-68dfb8e2ce50 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:38.851896 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3574f039-7d47-4614-bc05-68dfb8e2ce50 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:38.852921 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3574f039-7d47-4614-bc05-68dfb8e2ce50 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:38.853649 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3574f039-7d47-4614-bc05-68dfb8e2ce50 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:38.854143 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3574f039-7d47-4614-bc05-68dfb8e2ce50 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:39.004600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3574f039-7d47-4614-bc05-68dfb8e2ce50 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:39.015673 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3574f039-7d47-4614-bc05-68dfb8e2ce50 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.177263 Aug 29 19:10:39.031634 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 230/461] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:38 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:39.135383 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f5246c81-cc60-4be3-b2d8-a1be06b2fc07 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:39.136173 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f5246c81-cc60-4be3-b2d8-a1be06b2fc07 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:39.160598 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f5246c81-cc60-4be3-b2d8-a1be06b2fc07 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:39.161499 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f5246c81-cc60-4be3-b2d8-a1be06b2fc07 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:39.162202 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f5246c81-cc60-4be3-b2d8-a1be06b2fc07 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:39.163326 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f5246c81-cc60-4be3-b2d8-a1be06b2fc07 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:39.164610 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f5246c81-cc60-4be3-b2d8-a1be06b2fc07 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:39.165607 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f5246c81-cc60-4be3-b2d8-a1be06b2fc07 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:39.424160 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f5246c81-cc60-4be3-b2d8-a1be06b2fc07 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:39.468224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f5246c81-cc60-4be3-b2d8-a1be06b2fc07 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.339690 Aug 29 19:10:39.488503 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 232/462] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:39 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:39.669979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f80dc86a-7ffb-4ed3-86bf-a5df83f12285 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:39.670671 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f80dc86a-7ffb-4ed3-86bf-a5df83f12285 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:39.677723 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f80dc86a-7ffb-4ed3-86bf-a5df83f12285 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:39.678204 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f80dc86a-7ffb-4ed3-86bf-a5df83f12285 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:39.678639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f80dc86a-7ffb-4ed3-86bf-a5df83f12285 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:39.679362 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f80dc86a-7ffb-4ed3-86bf-a5df83f12285 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:39.680466 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f80dc86a-7ffb-4ed3-86bf-a5df83f12285 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:39.681250 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f80dc86a-7ffb-4ed3-86bf-a5df83f12285 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:39.756804 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f80dc86a-7ffb-4ed3-86bf-a5df83f12285 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:39.771354 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f80dc86a-7ffb-4ed3-86bf-a5df83f12285 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1186 microversion: 2.1 time: 0.109181 Aug 29 19:10:39.772216 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 231/463] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:39 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1186 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:39.776207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:39.777170 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:39.784559 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:39.786232 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:39.786682 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:39.787415 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:39.788190 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:39.788821 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:39.948754 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:39.958489 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:39.959975 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:39.961175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1fac5aec-80dd-4f25-92c2-b61b4921799b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.189254 Aug 29 19:10:39.965620 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 233/464] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:39 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:10:40.040966 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-82ceda11-8d9c-4811-9903-065c1ae39045 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:40.042899 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-82ceda11-8d9c-4811-9903-065c1ae39045 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:40.049838 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82ceda11-8d9c-4811-9903-065c1ae39045 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:40.050402 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82ceda11-8d9c-4811-9903-065c1ae39045 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:40.050909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82ceda11-8d9c-4811-9903-065c1ae39045 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:40.051950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82ceda11-8d9c-4811-9903-065c1ae39045 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:40.052469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82ceda11-8d9c-4811-9903-065c1ae39045 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:40.052956 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82ceda11-8d9c-4811-9903-065c1ae39045 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:40.211963 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-82ceda11-8d9c-4811-9903-065c1ae39045 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:40.221366 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-82ceda11-8d9c-4811-9903-065c1ae39045 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.187233 Aug 29 19:10:40.221970 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 232/465] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:40 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:40.501415 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-38d071e7-f208-4a93-9a3c-bc55f2cffd32 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:40.503200 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-38d071e7-f208-4a93-9a3c-bc55f2cffd32 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:40.512086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38d071e7-f208-4a93-9a3c-bc55f2cffd32 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:40.512599 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38d071e7-f208-4a93-9a3c-bc55f2cffd32 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:40.513174 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38d071e7-f208-4a93-9a3c-bc55f2cffd32 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:40.518275 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38d071e7-f208-4a93-9a3c-bc55f2cffd32 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:40.518958 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38d071e7-f208-4a93-9a3c-bc55f2cffd32 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:40.519687 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38d071e7-f208-4a93-9a3c-bc55f2cffd32 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:40.669229 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-38d071e7-f208-4a93-9a3c-bc55f2cffd32 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:40.677335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-38d071e7-f208-4a93-9a3c-bc55f2cffd32 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.181225 Aug 29 19:10:40.690479 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 234/466] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:40 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:40.793289 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a31d8abc-9c50-429c-bbb8-a8b9678ae7ae tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:40.794357 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a31d8abc-9c50-429c-bbb8-a8b9678ae7ae tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:40.801077 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a31d8abc-9c50-429c-bbb8-a8b9678ae7ae tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:40.802145 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a31d8abc-9c50-429c-bbb8-a8b9678ae7ae tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:40.803053 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a31d8abc-9c50-429c-bbb8-a8b9678ae7ae tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:40.804709 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a31d8abc-9c50-429c-bbb8-a8b9678ae7ae tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:40.805566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a31d8abc-9c50-429c-bbb8-a8b9678ae7ae tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:40.806214 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a31d8abc-9c50-429c-bbb8-a8b9678ae7ae tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:40.881378 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a31d8abc-9c50-429c-bbb8-a8b9678ae7ae tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:40.890005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a31d8abc-9c50-429c-bbb8-a8b9678ae7ae tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1186 microversion: 2.1 time: 0.101033 Aug 29 19:10:40.892063 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 233/467] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:40 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:40.986345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:40.986789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:40.994262 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:40.994765 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:40.995236 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:40.996063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:40.996537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:40.996968 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:41.141443 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:41.150905 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:41.153304 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:41.154530 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-080634c0-56f1-4dd9-b77e-dcd5a36fd993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.172501 Aug 29 19:10:41.155444 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 235/468] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:40 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:41.243241 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b9635ccf-0194-44e8-aaaf-441c37ae7c9b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:41.243784 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b9635ccf-0194-44e8-aaaf-441c37ae7c9b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:41.249885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9635ccf-0194-44e8-aaaf-441c37ae7c9b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:41.250371 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9635ccf-0194-44e8-aaaf-441c37ae7c9b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:41.250809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9635ccf-0194-44e8-aaaf-441c37ae7c9b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:41.251539 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9635ccf-0194-44e8-aaaf-441c37ae7c9b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:41.251993 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9635ccf-0194-44e8-aaaf-441c37ae7c9b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:41.252419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9635ccf-0194-44e8-aaaf-441c37ae7c9b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:41.382809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b9635ccf-0194-44e8-aaaf-441c37ae7c9b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:41.391099 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b9635ccf-0194-44e8-aaaf-441c37ae7c9b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.151831 Aug 29 19:10:41.391670 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 234/469] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:41 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:41.697668 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-dda91cd4-7a90-4cad-abd8-c4e2747a49ef tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:41.698296 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-dda91cd4-7a90-4cad-abd8-c4e2747a49ef tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:41.705367 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dda91cd4-7a90-4cad-abd8-c4e2747a49ef tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:41.705849 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dda91cd4-7a90-4cad-abd8-c4e2747a49ef tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:41.706277 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dda91cd4-7a90-4cad-abd8-c4e2747a49ef tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:41.706968 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dda91cd4-7a90-4cad-abd8-c4e2747a49ef tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:41.707448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dda91cd4-7a90-4cad-abd8-c4e2747a49ef tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:41.707869 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dda91cd4-7a90-4cad-abd8-c4e2747a49ef tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:41.869112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-dda91cd4-7a90-4cad-abd8-c4e2747a49ef tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:41.877591 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-dda91cd4-7a90-4cad-abd8-c4e2747a49ef tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.183687 Aug 29 19:10:41.878156 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 236/470] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:41 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:41.911588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-63cfd7f7-9eac-4944-839c-4242177697e9 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:41.912197 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-63cfd7f7-9eac-4944-839c-4242177697e9 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:41.918102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-63cfd7f7-9eac-4944-839c-4242177697e9 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:41.918584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-63cfd7f7-9eac-4944-839c-4242177697e9 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:41.919019 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-63cfd7f7-9eac-4944-839c-4242177697e9 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:41.919731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-63cfd7f7-9eac-4944-839c-4242177697e9 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:41.920186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-63cfd7f7-9eac-4944-839c-4242177697e9 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:41.920609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-63cfd7f7-9eac-4944-839c-4242177697e9 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:41.982194 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-63cfd7f7-9eac-4944-839c-4242177697e9 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:41.989815 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-63cfd7f7-9eac-4944-839c-4242177697e9 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1186 microversion: 2.1 time: 0.082444 Aug 29 19:10:41.990384 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 235/471] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:41 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:42.177861 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:42.178464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:42.191711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:42.192196 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:42.192626 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:42.193314 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:42.193763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:42.194179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:42.324374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:42.332491 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:42.333911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:42.335144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-bc9e33fc-1276-4c09-814d-fc9ab64c92e1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.161165 Aug 29 19:10:42.335701 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 237/472] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:42 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:42.412870 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a9edcd5d-003f-43c0-8263-36f6f3d9ff40 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:42.413490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a9edcd5d-003f-43c0-8263-36f6f3d9ff40 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:42.419889 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9edcd5d-003f-43c0-8263-36f6f3d9ff40 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:42.420370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9edcd5d-003f-43c0-8263-36f6f3d9ff40 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:42.420803 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9edcd5d-003f-43c0-8263-36f6f3d9ff40 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:42.421484 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9edcd5d-003f-43c0-8263-36f6f3d9ff40 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:42.421936 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9edcd5d-003f-43c0-8263-36f6f3d9ff40 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:42.422352 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9edcd5d-003f-43c0-8263-36f6f3d9ff40 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:42.559500 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a9edcd5d-003f-43c0-8263-36f6f3d9ff40 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:42.566444 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a9edcd5d-003f-43c0-8263-36f6f3d9ff40 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.157624 Aug 29 19:10:42.567015 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 236/473] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:42 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:42.899999 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-622191ef-a91c-411b-8e0d-4683a7dad52a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:42.901535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-622191ef-a91c-411b-8e0d-4683a7dad52a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:42.910293 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-622191ef-a91c-411b-8e0d-4683a7dad52a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:42.910929 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-622191ef-a91c-411b-8e0d-4683a7dad52a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:42.911515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-622191ef-a91c-411b-8e0d-4683a7dad52a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:42.912444 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-622191ef-a91c-411b-8e0d-4683a7dad52a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:42.912909 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-622191ef-a91c-411b-8e0d-4683a7dad52a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:42.913366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-622191ef-a91c-411b-8e0d-4683a7dad52a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:42.953092 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-97caa890-5354-4fab-a2b2-65d41146acab req-3dc4f6db-df30-4986-90db-22c6fb23fa86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0236f3d8-fe14-4ea6-a952-ad43a97260aa", "name": "network-vif-plugged", "status": "completed", "tag": "f5ea5791-6357-48d5-bdaa-4b91eacc1a22"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:42.964325 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-97caa890-5354-4fab-a2b2-65d41146acab req-3dc4f6db-df30-4986-90db-22c6fb23fa86 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:42.964874 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-97caa890-5354-4fab-a2b2-65d41146acab req-3dc4f6db-df30-4986-90db-22c6fb23fa86 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:42.966088 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-97caa890-5354-4fab-a2b2-65d41146acab req-3dc4f6db-df30-4986-90db-22c6fb23fa86 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:42.979703 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-97caa890-5354-4fab-a2b2-65d41146acab req-3dc4f6db-df30-4986-90db-22c6fb23fa86 service nova] Creating event network-vif-plugged:f5ea5791-6357-48d5-bdaa-4b91eacc1a22 for instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa on hv-cinder-73126 Aug 29 19:10:42.986198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-97caa890-5354-4fab-a2b2-65d41146acab req-3dc4f6db-df30-4986-90db-22c6fb23fa86 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038251 Aug 29 19:10:42.987426 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 237/474] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:43.011637 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ee256c8e-5ca7-4173-9343-f48e78be3a71 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:43.012935 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ee256c8e-5ca7-4173-9343-f48e78be3a71 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:43.019692 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ee256c8e-5ca7-4173-9343-f48e78be3a71 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:43.020538 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ee256c8e-5ca7-4173-9343-f48e78be3a71 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:43.021001 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ee256c8e-5ca7-4173-9343-f48e78be3a71 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:43.021971 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ee256c8e-5ca7-4173-9343-f48e78be3a71 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:43.022565 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ee256c8e-5ca7-4173-9343-f48e78be3a71 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:43.023032 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ee256c8e-5ca7-4173-9343-f48e78be3a71 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:43.123802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ee256c8e-5ca7-4173-9343-f48e78be3a71 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:43.131763 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ee256c8e-5ca7-4173-9343-f48e78be3a71 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1194 microversion: 2.1 time: 0.124307 Aug 29 19:10:43.132417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 238/475] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:43 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1194 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:43.151854 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-622191ef-a91c-411b-8e0d-4683a7dad52a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:43.161194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-622191ef-a91c-411b-8e0d-4683a7dad52a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.265321 Aug 29 19:10:43.161781 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 238/476] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:42 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:43.359425 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:43.360184 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:43.366212 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:43.366914 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:43.367166 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:43.367867 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:43.368324 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:43.368755 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:43.588039 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-af0f2a44-85af-4156-aba5-35c9e22865dd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:43.588646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-af0f2a44-85af-4156-aba5-35c9e22865dd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:43.589831 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:43.595030 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-af0f2a44-85af-4156-aba5-35c9e22865dd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:43.595544 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-af0f2a44-85af-4156-aba5-35c9e22865dd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:43.595970 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-af0f2a44-85af-4156-aba5-35c9e22865dd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:43.596665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-af0f2a44-85af-4156-aba5-35c9e22865dd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:43.597114 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-af0f2a44-85af-4156-aba5-35c9e22865dd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:43.597534 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-af0f2a44-85af-4156-aba5-35c9e22865dd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:43.598370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:43.599848 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:43.601015 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-eac505e6-89ba-4167-945e-c643f9d851fa tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1738 microversion: 2.20 time: 0.246081 Aug 29 19:10:43.601652 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 239/477] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:43 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:43.859293 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-af0f2a44-85af-4156-aba5-35c9e22865dd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:43.872755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-af0f2a44-85af-4156-aba5-35c9e22865dd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.288421 Aug 29 19:10:43.873344 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 239/478] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:43 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:44.154300 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-210ca166-d490-487d-b762-d2437e212491 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:44.154820 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-210ca166-d490-487d-b762-d2437e212491 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:44.160961 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-210ca166-d490-487d-b762-d2437e212491 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:44.161430 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-210ca166-d490-487d-b762-d2437e212491 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:44.161857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-210ca166-d490-487d-b762-d2437e212491 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:44.162530 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-210ca166-d490-487d-b762-d2437e212491 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:44.162976 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-210ca166-d490-487d-b762-d2437e212491 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:44.163423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-210ca166-d490-487d-b762-d2437e212491 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:44.183031 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d80ef2b8-0597-4372-bc1f-2445ec4436ad tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:44.183673 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d80ef2b8-0597-4372-bc1f-2445ec4436ad tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:44.190370 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d80ef2b8-0597-4372-bc1f-2445ec4436ad tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:44.190865 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d80ef2b8-0597-4372-bc1f-2445ec4436ad tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:44.191335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d80ef2b8-0597-4372-bc1f-2445ec4436ad tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:44.192032 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d80ef2b8-0597-4372-bc1f-2445ec4436ad tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:44.192514 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d80ef2b8-0597-4372-bc1f-2445ec4436ad tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:44.192938 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d80ef2b8-0597-4372-bc1f-2445ec4436ad tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:44.225103 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-210ca166-d490-487d-b762-d2437e212491 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:44.233450 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-210ca166-d490-487d-b762-d2437e212491 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1204 microversion: 2.1 time: 0.083702 Aug 29 19:10:44.234026 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 240/479] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:44 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1204 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:44.321407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d80ef2b8-0597-4372-bc1f-2445ec4436ad tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:44.329832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d80ef2b8-0597-4372-bc1f-2445ec4436ad tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.150598 Aug 29 19:10:44.330398 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 240/480] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:44 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:44.627029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:44.627666 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:44.633629 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:44.634118 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:44.634557 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:44.635288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:44.635748 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:44.636173 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:44.767690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:44.775715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:44.777158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:44.778479 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-848531d1-1ebf-4512-ad2a-61902d935f6a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1720 microversion: 2.20 time: 0.156971 Aug 29 19:10:44.779040 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 241/481] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:44 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:44.893984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-196ff4bf-896e-4b01-aead-2dec3396ae2d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:44.894593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-196ff4bf-896e-4b01-aead-2dec3396ae2d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:44.900729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-196ff4bf-896e-4b01-aead-2dec3396ae2d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:44.901221 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-196ff4bf-896e-4b01-aead-2dec3396ae2d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:44.901653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-196ff4bf-896e-4b01-aead-2dec3396ae2d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:44.902350 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-196ff4bf-896e-4b01-aead-2dec3396ae2d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:44.903009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-196ff4bf-896e-4b01-aead-2dec3396ae2d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:44.903446 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-196ff4bf-896e-4b01-aead-2dec3396ae2d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:44.908678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:45.033164 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-196ff4bf-896e-4b01-aead-2dec3396ae2d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:45.040935 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-196ff4bf-896e-4b01-aead-2dec3396ae2d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.150767 Aug 29 19:10:45.041489 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 241/482] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:44 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:45.253803 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-827ee186-979b-4385-94b8-c14ee2eae9f2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:45.254332 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-827ee186-979b-4385-94b8-c14ee2eae9f2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:45.260510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827ee186-979b-4385-94b8-c14ee2eae9f2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:45.261124 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827ee186-979b-4385-94b8-c14ee2eae9f2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:45.261569 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827ee186-979b-4385-94b8-c14ee2eae9f2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:45.262987 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827ee186-979b-4385-94b8-c14ee2eae9f2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:45.263504 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827ee186-979b-4385-94b8-c14ee2eae9f2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:45.264007 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-827ee186-979b-4385-94b8-c14ee2eae9f2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:45.325973 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-827ee186-979b-4385-94b8-c14ee2eae9f2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:45.333651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-827ee186-979b-4385-94b8-c14ee2eae9f2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1204 microversion: 2.1 time: 0.084014 Aug 29 19:10:45.334220 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 242/483] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:45 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1204 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:45.351007 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-522627d3-b582-4ac6-b64c-f97b879c40f8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:45.351653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-522627d3-b582-4ac6-b64c-f97b879c40f8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:45.358104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-522627d3-b582-4ac6-b64c-f97b879c40f8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:45.358585 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-522627d3-b582-4ac6-b64c-f97b879c40f8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:45.359025 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-522627d3-b582-4ac6-b64c-f97b879c40f8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:45.359820 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-522627d3-b582-4ac6-b64c-f97b879c40f8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:45.360279 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-522627d3-b582-4ac6-b64c-f97b879c40f8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:45.360705 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-522627d3-b582-4ac6-b64c-f97b879c40f8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:45.494036 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-522627d3-b582-4ac6-b64c-f97b879c40f8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:45.502662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-522627d3-b582-4ac6-b64c-f97b879c40f8 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.155472 Aug 29 19:10:45.503265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 242/484] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:45 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:45.802014 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:45.802631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:45.808727 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:45.809213 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:45.809827 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:45.810534 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:45.810990 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:45.811441 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:45.945679 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:45.949249 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:45.955534 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:45.956972 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:45.958120 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-96a971aa-2490-49fb-af62-c3781647f88b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1720 microversion: 2.20 time: 0.160030 Aug 29 19:10:45.958675 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 243/485] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:45 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:46.062029 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f18a3bb4-53b9-4a30-ab6b-e50ff8f482c9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:46.062565 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f18a3bb4-53b9-4a30-ab6b-e50ff8f482c9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:46.068618 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f18a3bb4-53b9-4a30-ab6b-e50ff8f482c9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:46.069106 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f18a3bb4-53b9-4a30-ab6b-e50ff8f482c9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:46.069549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f18a3bb4-53b9-4a30-ab6b-e50ff8f482c9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:46.070242 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f18a3bb4-53b9-4a30-ab6b-e50ff8f482c9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:46.070699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f18a3bb4-53b9-4a30-ab6b-e50ff8f482c9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:46.071154 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f18a3bb4-53b9-4a30-ab6b-e50ff8f482c9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:46.202103 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f18a3bb4-53b9-4a30-ab6b-e50ff8f482c9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:46.209726 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f18a3bb4-53b9-4a30-ab6b-e50ff8f482c9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.152194 Aug 29 19:10:46.210293 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 243/486] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:46 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:46.353889 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-45f26be9-ccb6-4346-b0e5-7ec6d1ce9d30 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:46.354415 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-45f26be9-ccb6-4346-b0e5-7ec6d1ce9d30 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:46.361271 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-45f26be9-ccb6-4346-b0e5-7ec6d1ce9d30 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:46.361752 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-45f26be9-ccb6-4346-b0e5-7ec6d1ce9d30 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:46.362183 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-45f26be9-ccb6-4346-b0e5-7ec6d1ce9d30 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:46.362859 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-45f26be9-ccb6-4346-b0e5-7ec6d1ce9d30 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:46.363331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-45f26be9-ccb6-4346-b0e5-7ec6d1ce9d30 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:46.363751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-45f26be9-ccb6-4346-b0e5-7ec6d1ce9d30 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:46.423962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-45f26be9-ccb6-4346-b0e5-7ec6d1ce9d30 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:46.431543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-45f26be9-ccb6-4346-b0e5-7ec6d1ce9d30 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1204 microversion: 2.1 time: 0.081628 Aug 29 19:10:46.432106 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 244/487] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:46 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1204 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:46.523595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c05dc7fe-f02c-4e11-b70b-6536813ddcc9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:46.524246 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c05dc7fe-f02c-4e11-b70b-6536813ddcc9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:46.532324 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c05dc7fe-f02c-4e11-b70b-6536813ddcc9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:46.532808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c05dc7fe-f02c-4e11-b70b-6536813ddcc9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:46.533237 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c05dc7fe-f02c-4e11-b70b-6536813ddcc9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:46.533918 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c05dc7fe-f02c-4e11-b70b-6536813ddcc9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:46.534363 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c05dc7fe-f02c-4e11-b70b-6536813ddcc9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:46.534783 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c05dc7fe-f02c-4e11-b70b-6536813ddcc9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:46.668767 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c05dc7fe-f02c-4e11-b70b-6536813ddcc9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:46.676449 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c05dc7fe-f02c-4e11-b70b-6536813ddcc9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.156640 Aug 29 19:10:46.677022 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 244/488] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:46 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:46.981171 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:46.981808 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:46.984695 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:46.989876 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:46.990368 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:46.990805 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:46.991544 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:46.992000 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:46.992428 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:47.130126 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:47.138358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:47.139837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:47.141099 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f5358efb-7c2d-403f-be4a-702406551690 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1720 microversion: 2.20 time: 0.163860 Aug 29 19:10:47.141676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 245/489] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:46 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:47.230772 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d2884327-aa4d-4044-b0b8-8802354f4514 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:47.232105 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d2884327-aa4d-4044-b0b8-8802354f4514 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:47.238218 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d2884327-aa4d-4044-b0b8-8802354f4514 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:47.238707 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d2884327-aa4d-4044-b0b8-8802354f4514 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:47.239195 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d2884327-aa4d-4044-b0b8-8802354f4514 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:47.239886 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d2884327-aa4d-4044-b0b8-8802354f4514 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:47.240336 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d2884327-aa4d-4044-b0b8-8802354f4514 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:47.240760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d2884327-aa4d-4044-b0b8-8802354f4514 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:47.367752 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d2884327-aa4d-4044-b0b8-8802354f4514 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:47.376011 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d2884327-aa4d-4044-b0b8-8802354f4514 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.149199 Aug 29 19:10:47.376584 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 245/490] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:47 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:47.454583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ba7b0c63-40fb-4a95-8b4e-e7d87b1fc95c tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:47.455218 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ba7b0c63-40fb-4a95-8b4e-e7d87b1fc95c tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:47.457080 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=8 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:47.462611 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ba7b0c63-40fb-4a95-8b4e-e7d87b1fc95c tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:47.463167 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ba7b0c63-40fb-4a95-8b4e-e7d87b1fc95c tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:47.463599 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ba7b0c63-40fb-4a95-8b4e-e7d87b1fc95c tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:47.464294 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ba7b0c63-40fb-4a95-8b4e-e7d87b1fc95c tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:47.464750 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ba7b0c63-40fb-4a95-8b4e-e7d87b1fc95c tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:47.465172 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ba7b0c63-40fb-4a95-8b4e-e7d87b1fc95c tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:47.526991 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ba7b0c63-40fb-4a95-8b4e-e7d87b1fc95c tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:47.535620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ba7b0c63-40fb-4a95-8b4e-e7d87b1fc95c tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1204 microversion: 2.1 time: 0.086519 Aug 29 19:10:47.536186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 246/491] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:47 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1204 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:47.697393 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f12919fc-f069-48e2-aa33-ce09bacb0ce4 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:47.698005 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f12919fc-f069-48e2-aa33-ce09bacb0ce4 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:47.704588 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f12919fc-f069-48e2-aa33-ce09bacb0ce4 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:47.705080 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f12919fc-f069-48e2-aa33-ce09bacb0ce4 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:47.705519 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f12919fc-f069-48e2-aa33-ce09bacb0ce4 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:47.706211 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f12919fc-f069-48e2-aa33-ce09bacb0ce4 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:47.706670 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f12919fc-f069-48e2-aa33-ce09bacb0ce4 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:47.707118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f12919fc-f069-48e2-aa33-ce09bacb0ce4 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:48.164729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:48.165399 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:48.171544 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:48.172039 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:48.172476 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:48.173179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:48.173670 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:48.174055 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:48.197941 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f12919fc-f069-48e2-aa33-ce09bacb0ce4 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:48.207453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f12919fc-f069-48e2-aa33-ce09bacb0ce4 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.513774 Aug 29 19:10:48.208308 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 246/492] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:47 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:48.365693 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:48.374346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:48.375808 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:48.376960 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8cd83160-1a97-4c12-b6ff-506bff6cd3d2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1720 microversion: 2.20 time: 0.216130 Aug 29 19:10:48.377518 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 247/493] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:48 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:10:48.396815 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-84c8375e-3cb9-4791-a3ef-ff64a8b89a4a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:48.397433 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-84c8375e-3cb9-4791-a3ef-ff64a8b89a4a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:48.404214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-84c8375e-3cb9-4791-a3ef-ff64a8b89a4a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:48.404833 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-84c8375e-3cb9-4791-a3ef-ff64a8b89a4a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:48.405272 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-84c8375e-3cb9-4791-a3ef-ff64a8b89a4a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:48.405971 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-84c8375e-3cb9-4791-a3ef-ff64a8b89a4a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:48.406431 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-84c8375e-3cb9-4791-a3ef-ff64a8b89a4a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:48.406854 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-84c8375e-3cb9-4791-a3ef-ff64a8b89a4a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:48.557421 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b9fec4e4-a3d9-4e3f-b05c-ef0f94fcb85b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:48.557928 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b9fec4e4-a3d9-4e3f-b05c-ef0f94fcb85b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:48.564649 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9fec4e4-a3d9-4e3f-b05c-ef0f94fcb85b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:48.565138 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9fec4e4-a3d9-4e3f-b05c-ef0f94fcb85b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:48.565568 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9fec4e4-a3d9-4e3f-b05c-ef0f94fcb85b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:48.566266 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9fec4e4-a3d9-4e3f-b05c-ef0f94fcb85b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:48.566714 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9fec4e4-a3d9-4e3f-b05c-ef0f94fcb85b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:48.567165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9fec4e4-a3d9-4e3f-b05c-ef0f94fcb85b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:48.648284 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-84c8375e-3cb9-4791-a3ef-ff64a8b89a4a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:48.656870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-84c8375e-3cb9-4791-a3ef-ff64a8b89a4a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1370 microversion: 2.1 time: 0.263851 Aug 29 19:10:48.657446 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 247/494] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:48 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:48.666582 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b9fec4e4-a3d9-4e3f-b05c-ef0f94fcb85b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:48.674579 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b9fec4e4-a3d9-4e3f-b05c-ef0f94fcb85b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1204 microversion: 2.1 time: 0.121532 Aug 29 19:10:48.675165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 248/495] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:48 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1204 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:48.933254 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-42114308-e5eb-4b78-9fd6-c8db44132864 req-57b180ed-12e1-493b-86d4-3774e6413f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4696f764-f3e7-482f-b94e-549896198ddf", "name": "network-vif-unplugged", "status": "completed", "tag": "90bec49f-36b1-4027-8fc3-86cd4d15e3f4"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:48.945466 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-42114308-e5eb-4b78-9fd6-c8db44132864 req-57b180ed-12e1-493b-86d4-3774e6413f1d service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:48.945949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-42114308-e5eb-4b78-9fd6-c8db44132864 req-57b180ed-12e1-493b-86d4-3774e6413f1d service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:48.946378 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-42114308-e5eb-4b78-9fd6-c8db44132864 req-57b180ed-12e1-493b-86d4-3774e6413f1d service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:48.963662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-42114308-e5eb-4b78-9fd6-c8db44132864 req-57b180ed-12e1-493b-86d4-3774e6413f1d service nova] Creating event network-vif-unplugged:90bec49f-36b1-4027-8fc3-86cd4d15e3f4 for instance 4696f764-f3e7-482f-b94e-549896198ddf on hv-cinder-73126 Aug 29 19:10:48.969605 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-42114308-e5eb-4b78-9fd6-c8db44132864 req-57b180ed-12e1-493b-86d4-3774e6413f1d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039968 Aug 29 19:10:48.970554 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 248/496] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:49.228424 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b6149e4e-fdd9-4ca0-b795-44544e03bc7d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:49.229023 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b6149e4e-fdd9-4ca0-b795-44544e03bc7d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:49.236037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6149e4e-fdd9-4ca0-b795-44544e03bc7d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:49.236583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6149e4e-fdd9-4ca0-b795-44544e03bc7d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:49.237005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6149e4e-fdd9-4ca0-b795-44544e03bc7d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:49.237704 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6149e4e-fdd9-4ca0-b795-44544e03bc7d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:49.238165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6149e4e-fdd9-4ca0-b795-44544e03bc7d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:49.238597 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6149e4e-fdd9-4ca0-b795-44544e03bc7d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:49.369866 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b6149e4e-fdd9-4ca0-b795-44544e03bc7d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:49.377784 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b6149e4e-fdd9-4ca0-b795-44544e03bc7d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.153220 Aug 29 19:10:49.378524 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 249/497] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:49 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:49.401616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:49.402317 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:49.409374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:49.409870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:49.410567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:49.411374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:49.411835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:49.412526 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:49.663561 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:49.677406 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:49.678288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3811cc2b-312e-4d16-bbb9-b0c91427a33e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:49.678906 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3811cc2b-312e-4d16-bbb9-b0c91427a33e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:49.679028 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:49.683956 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-07e40799-1184-40e3-a24f-6810bbad0220 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1720 microversion: 2.20 time: 0.286501 Aug 29 19:10:49.685731 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 249/498] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:49 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1720 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:49.687025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3811cc2b-312e-4d16-bbb9-b0c91427a33e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:49.687555 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3811cc2b-312e-4d16-bbb9-b0c91427a33e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:49.689907 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3811cc2b-312e-4d16-bbb9-b0c91427a33e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:49.690847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3811cc2b-312e-4d16-bbb9-b0c91427a33e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:49.692371 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3811cc2b-312e-4d16-bbb9-b0c91427a33e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:49.693119 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3811cc2b-312e-4d16-bbb9-b0c91427a33e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:49.697063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-deb39639-35b9-45f6-b28a-4fe15d58988d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:49.697853 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-deb39639-35b9-45f6-b28a-4fe15d58988d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:49.707532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-deb39639-35b9-45f6-b28a-4fe15d58988d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:49.708204 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-deb39639-35b9-45f6-b28a-4fe15d58988d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:49.708869 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-deb39639-35b9-45f6-b28a-4fe15d58988d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:49.709783 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-deb39639-35b9-45f6-b28a-4fe15d58988d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:49.710255 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-deb39639-35b9-45f6-b28a-4fe15d58988d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:49.710797 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-deb39639-35b9-45f6-b28a-4fe15d58988d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:49.992292 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3811cc2b-312e-4d16-bbb9-b0c91427a33e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:49.999798 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-deb39639-35b9-45f6-b28a-4fe15d58988d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:50.001433 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3811cc2b-312e-4d16-bbb9-b0c91427a33e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1564 microversion: 2.1 time: 0.327703 Aug 29 19:10:50.002128 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 250/499] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:49 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1564 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:50.015377 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-deb39639-35b9-45f6-b28a-4fe15d58988d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1272 microversion: 2.1 time: 0.316944 Aug 29 19:10:50.015377 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 250/500] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:49 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1272 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:50.024393 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b4282dab-3119-4c74-a885-0db3995a17e0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:50.024885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b4282dab-3119-4c74-a885-0db3995a17e0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:50.031061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b4282dab-3119-4c74-a885-0db3995a17e0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:50.031568 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b4282dab-3119-4c74-a885-0db3995a17e0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:50.032001 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b4282dab-3119-4c74-a885-0db3995a17e0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:50.032687 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b4282dab-3119-4c74-a885-0db3995a17e0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:50.033143 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b4282dab-3119-4c74-a885-0db3995a17e0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:50.033563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b4282dab-3119-4c74-a885-0db3995a17e0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:50.132262 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b4282dab-3119-4c74-a885-0db3995a17e0 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112044 Aug 29 19:10:50.132870 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 251/501] 10.222.0.94 () {58 vars in 1275 bytes} [Mon Aug 29 19:10:50 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:50.335517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-5c3cce58-a630-43bb-b923-2b4c1525ad78 req-7f37ad33-a058-401e-95ce-a97da66f52f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337970a7-0d96-4590-bbf0-e7e1b2fae6ac", "tag": "bc2fe8d5-1c6f-407b-8613-774dc48866ca"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:50.345121 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-5c3cce58-a630-43bb-b923-2b4c1525ad78 req-7f37ad33-a058-401e-95ce-a97da66f52f4 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:50.345838 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-5c3cce58-a630-43bb-b923-2b4c1525ad78 req-7f37ad33-a058-401e-95ce-a97da66f52f4 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:50.346458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-5c3cce58-a630-43bb-b923-2b4c1525ad78 req-7f37ad33-a058-401e-95ce-a97da66f52f4 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:50.358556 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-5c3cce58-a630-43bb-b923-2b4c1525ad78 req-7f37ad33-a058-401e-95ce-a97da66f52f4 service nova] Creating event network-changed:bc2fe8d5-1c6f-407b-8613-774dc48866ca for instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac on hv-cinder-73126 Aug 29 19:10:50.363479 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-5c3cce58-a630-43bb-b923-2b4c1525ad78 req-7f37ad33-a058-401e-95ce-a97da66f52f4 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031826 Aug 29 19:10:50.364088 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 251/502] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:50.399622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-21fc8a79-b9d0-49fb-8618-af26218be83a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:50.400234 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-21fc8a79-b9d0-49fb-8618-af26218be83a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:50.406382 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-21fc8a79-b9d0-49fb-8618-af26218be83a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:50.406869 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-21fc8a79-b9d0-49fb-8618-af26218be83a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:50.407342 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-21fc8a79-b9d0-49fb-8618-af26218be83a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:50.408041 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-21fc8a79-b9d0-49fb-8618-af26218be83a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:50.408496 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-21fc8a79-b9d0-49fb-8618-af26218be83a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:50.408923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-21fc8a79-b9d0-49fb-8618-af26218be83a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:50.588585 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-21fc8a79-b9d0-49fb-8618-af26218be83a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:50.597139 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-21fc8a79-b9d0-49fb-8618-af26218be83a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.201332 Aug 29 19:10:50.597713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 252/503] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:50 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:50.709393 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:50.710163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:50.717552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:50.718042 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:50.718479 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:50.719223 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:50.719687 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:50.720112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:51.032052 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:51.036824 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f29dd79c-a10d-42cf-9e36-c23ddecb7d7d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:51.040826 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f29dd79c-a10d-42cf-9e36-c23ddecb7d7d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:51.058407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:51.062307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:51.063453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f29dd79c-a10d-42cf-9e36-c23ddecb7d7d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:51.064305 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f29dd79c-a10d-42cf-9e36-c23ddecb7d7d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:51.066154 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f29dd79c-a10d-42cf-9e36-c23ddecb7d7d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:51.067037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f29dd79c-a10d-42cf-9e36-c23ddecb7d7d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:51.067589 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0e9ae278-0a0a-4496-a3ee-be144fe176e0 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1720 microversion: 2.20 time: 0.360644 Aug 29 19:10:51.069631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f29dd79c-a10d-42cf-9e36-c23ddecb7d7d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:51.069805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 252/504] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:50 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1720 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:51.070644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f29dd79c-a10d-42cf-9e36-c23ddecb7d7d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:51.264119 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f29dd79c-a10d-42cf-9e36-c23ddecb7d7d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:51.271797 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f29dd79c-a10d-42cf-9e36-c23ddecb7d7d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.243499 Aug 29 19:10:51.272364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 253/505] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:51 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:51.358331 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8b016e58-a1da-4e9f-b28b-fa51d9531679 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:51.358828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8b016e58-a1da-4e9f-b28b-fa51d9531679 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:51.364771 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b016e58-a1da-4e9f-b28b-fa51d9531679 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:51.365255 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b016e58-a1da-4e9f-b28b-fa51d9531679 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:51.365687 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b016e58-a1da-4e9f-b28b-fa51d9531679 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:51.366388 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b016e58-a1da-4e9f-b28b-fa51d9531679 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:51.366835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b016e58-a1da-4e9f-b28b-fa51d9531679 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:51.367366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b016e58-a1da-4e9f-b28b-fa51d9531679 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:51.479900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-f9d0ed80-d7ca-4695-b30c-9ae96814403f req-feedbacb-4ab6-49b5-972a-9de24cd44518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0236f3d8-fe14-4ea6-a952-ad43a97260aa", "tag": "f5ea5791-6357-48d5-bdaa-4b91eacc1a22"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:51.490338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-f9d0ed80-d7ca-4695-b30c-9ae96814403f req-feedbacb-4ab6-49b5-972a-9de24cd44518 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:51.490821 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-f9d0ed80-d7ca-4695-b30c-9ae96814403f req-feedbacb-4ab6-49b5-972a-9de24cd44518 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:51.491293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-f9d0ed80-d7ca-4695-b30c-9ae96814403f req-feedbacb-4ab6-49b5-972a-9de24cd44518 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:51.503951 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-f9d0ed80-d7ca-4695-b30c-9ae96814403f req-feedbacb-4ab6-49b5-972a-9de24cd44518 service nova] Creating event network-changed:f5ea5791-6357-48d5-bdaa-4b91eacc1a22 for instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa on hv-cinder-73126 Aug 29 19:10:51.506908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-8b016e58-a1da-4e9f-b28b-fa51d9531679 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lazy-loading 'services' on Instance uuid b37f271b-60ea-41f7-86d3-9a324c423afb {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:10:51.511835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-f9d0ed80-d7ca-4695-b30c-9ae96814403f req-feedbacb-4ab6-49b5-972a-9de24cd44518 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035644 Aug 29 19:10:51.516708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 254/506] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:51.623745 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6af2f5bf-180e-433c-8eba-c754bb1bbb04 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:51.624756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6af2f5bf-180e-433c-8eba-c754bb1bbb04 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:51.629626 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8b016e58-a1da-4e9f-b28b-fa51d9531679 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "DELETE /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb/os-volume_attachments/b4e9ded6-5043-4b54-9584-7f85465f86a2" status: 202 len: 0 microversion: 2.1 time: 0.275963 Aug 29 19:10:51.631922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6af2f5bf-180e-433c-8eba-c754bb1bbb04 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:51.632581 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6af2f5bf-180e-433c-8eba-c754bb1bbb04 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:51.633106 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6af2f5bf-180e-433c-8eba-c754bb1bbb04 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:51.634217 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6af2f5bf-180e-433c-8eba-c754bb1bbb04 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:51.634897 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6af2f5bf-180e-433c-8eba-c754bb1bbb04 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:51.635460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6af2f5bf-180e-433c-8eba-c754bb1bbb04 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:51.636031 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 253/507] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:10:51 2022] DELETE /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb/os-volume_attachments/b4e9ded6-5043-4b54-9584-7f85465f86a2 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:10:51.786244 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6af2f5bf-180e-433c-8eba-c754bb1bbb04 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:51.794698 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6af2f5bf-180e-433c-8eba-c754bb1bbb04 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.177385 Aug 29 19:10:51.795300 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 255/508] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:51 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:52.093437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:52.094190 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:52.100376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:52.100879 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:52.101317 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:52.102058 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:52.102519 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:52.102937 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:52.242189 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:52.251169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:52.252593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:52.253749 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-34cb1c94-fa46-48d6-a984-188be94786c9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1720 microversion: 2.20 time: 0.165744 Aug 29 19:10:52.254308 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 254/509] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:52 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:52.293803 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c061c78c-c794-456a-b2fc-bdf4050a8f93 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:52.295311 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c061c78c-c794-456a-b2fc-bdf4050a8f93 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:52.301147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c061c78c-c794-456a-b2fc-bdf4050a8f93 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:52.301865 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c061c78c-c794-456a-b2fc-bdf4050a8f93 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:52.302574 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c061c78c-c794-456a-b2fc-bdf4050a8f93 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:52.303697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c061c78c-c794-456a-b2fc-bdf4050a8f93 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:52.304418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c061c78c-c794-456a-b2fc-bdf4050a8f93 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:52.305084 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c061c78c-c794-456a-b2fc-bdf4050a8f93 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:52.439724 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c061c78c-c794-456a-b2fc-bdf4050a8f93 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:52.447510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c061c78c-c794-456a-b2fc-bdf4050a8f93 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.157675 Aug 29 19:10:52.448080 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 256/510] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:52 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:52.815475 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5f52f503-d8bb-4c01-a194-0a709eb1ca0a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:52.816089 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5f52f503-d8bb-4c01-a194-0a709eb1ca0a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:52.822296 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f52f503-d8bb-4c01-a194-0a709eb1ca0a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:52.822780 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f52f503-d8bb-4c01-a194-0a709eb1ca0a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:52.823264 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f52f503-d8bb-4c01-a194-0a709eb1ca0a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:52.823955 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f52f503-d8bb-4c01-a194-0a709eb1ca0a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:52.824410 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f52f503-d8bb-4c01-a194-0a709eb1ca0a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:52.824856 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5f52f503-d8bb-4c01-a194-0a709eb1ca0a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:52.957682 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5f52f503-d8bb-4c01-a194-0a709eb1ca0a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:52.965302 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5f52f503-d8bb-4c01-a194-0a709eb1ca0a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.153719 Aug 29 19:10:52.966021 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 255/511] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:52 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:53.279177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:53.280360 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:53.286709 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:53.287232 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:53.287670 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:53.288370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:53.288829 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:53.289257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:53.416407 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:53.425262 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:53.426727 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:53.427916 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a84f26f1-243c-42b4-986d-831f5fe1c167 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1720 microversion: 2.20 time: 0.152953 Aug 29 19:10:53.428484 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 257/512] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:53 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:53.469079 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-18e9e0ce-8b4d-4058-b7d7-2ddb403e26aa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:53.469690 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-18e9e0ce-8b4d-4058-b7d7-2ddb403e26aa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:53.476077 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18e9e0ce-8b4d-4058-b7d7-2ddb403e26aa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:53.476560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18e9e0ce-8b4d-4058-b7d7-2ddb403e26aa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:53.476994 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18e9e0ce-8b4d-4058-b7d7-2ddb403e26aa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:53.477677 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18e9e0ce-8b4d-4058-b7d7-2ddb403e26aa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:53.478126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18e9e0ce-8b4d-4058-b7d7-2ddb403e26aa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:53.478545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18e9e0ce-8b4d-4058-b7d7-2ddb403e26aa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:53.615598 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-18e9e0ce-8b4d-4058-b7d7-2ddb403e26aa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:53.623968 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-18e9e0ce-8b4d-4058-b7d7-2ddb403e26aa tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.160058 Aug 29 19:10:53.624533 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 256/513] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:53 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:53.814810 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-6363f61d-7b2a-45b1-8661-ca65f1147f90 req-8f89fd0c-8b3c-4efb-8c9a-97c3c61ccf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52e65bd-038e-4fc8-807e-4e4ce60c8db7", "name": "network-vif-plugged", "status": "completed", "tag": "32fdb103-82cb-4537-9dfe-6532b2639a2a"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:53.826075 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-6363f61d-7b2a-45b1-8661-ca65f1147f90 req-8f89fd0c-8b3c-4efb-8c9a-97c3c61ccf55 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:53.826559 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-6363f61d-7b2a-45b1-8661-ca65f1147f90 req-8f89fd0c-8b3c-4efb-8c9a-97c3c61ccf55 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:53.827000 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-6363f61d-7b2a-45b1-8661-ca65f1147f90 req-8f89fd0c-8b3c-4efb-8c9a-97c3c61ccf55 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:53.841419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-6363f61d-7b2a-45b1-8661-ca65f1147f90 req-8f89fd0c-8b3c-4efb-8c9a-97c3c61ccf55 service nova] Creating event network-vif-plugged:32fdb103-82cb-4537-9dfe-6532b2639a2a for instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 on hv-cinder-73126 Aug 29 19:10:53.846565 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-6363f61d-7b2a-45b1-8661-ca65f1147f90 req-8f89fd0c-8b3c-4efb-8c9a-97c3c61ccf55 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035499 Aug 29 19:10:53.847349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 258/514] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:10:53.986173 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b1887a7d-f160-40a9-8d2e-45d33c6275aa tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:53.986888 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b1887a7d-f160-40a9-8d2e-45d33c6275aa tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:53.993827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1887a7d-f160-40a9-8d2e-45d33c6275aa tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:53.994769 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1887a7d-f160-40a9-8d2e-45d33c6275aa tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:53.994769 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1887a7d-f160-40a9-8d2e-45d33c6275aa tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:53.999092 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1887a7d-f160-40a9-8d2e-45d33c6275aa tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:53.999092 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1887a7d-f160-40a9-8d2e-45d33c6275aa tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:53.999651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1887a7d-f160-40a9-8d2e-45d33c6275aa tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:54.177996 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b1887a7d-f160-40a9-8d2e-45d33c6275aa tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:54.187225 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b1887a7d-f160-40a9-8d2e-45d33c6275aa tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.204981 Aug 29 19:10:54.187814 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 257/515] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:53 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:54.453087 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:54.453694 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:54.460030 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:54.460616 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:54.461053 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:54.461741 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:54.462192 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:54.462610 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:54.647984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-564fb12f-3468-444a-bc42-6208d757e2f0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:54.649051 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-564fb12f-3468-444a-bc42-6208d757e2f0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:54.656516 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-564fb12f-3468-444a-bc42-6208d757e2f0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:54.657254 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-564fb12f-3468-444a-bc42-6208d757e2f0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:54.657879 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-564fb12f-3468-444a-bc42-6208d757e2f0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:54.658744 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-564fb12f-3468-444a-bc42-6208d757e2f0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:54.659386 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-564fb12f-3468-444a-bc42-6208d757e2f0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:54.660071 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-564fb12f-3468-444a-bc42-6208d757e2f0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:54.667399 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:54.677017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:54.678577 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:54.679840 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:54.680056 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-223ab054-2847-41df-972a-41c9739768bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1723 microversion: 2.20 time: 0.231885 Aug 29 19:10:54.680503 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 259/516] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:54 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:54.703986 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-55fdb1fc-7aa2-4f7a-875f-51f07dd63f5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0abefbe3-beab-40ee-b35a-64fcab97b6e0"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:54.706235 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-55fdb1fc-7aa2-4f7a-875f-51f07dd63f5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:54.712232 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-55fdb1fc-7aa2-4f7a-875f-51f07dd63f5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:54.712716 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-55fdb1fc-7aa2-4f7a-875f-51f07dd63f5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:54.713145 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-55fdb1fc-7aa2-4f7a-875f-51f07dd63f5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:54.713832 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-55fdb1fc-7aa2-4f7a-875f-51f07dd63f5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:54.714310 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-55fdb1fc-7aa2-4f7a-875f-51f07dd63f5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:54.714732 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-55fdb1fc-7aa2-4f7a-875f-51f07dd63f5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:54.798835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-564fb12f-3468-444a-bc42-6208d757e2f0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:54.807850 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-564fb12f-3468-444a-bc42-6208d757e2f0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.166279 Aug 29 19:10:54.808435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 258/517] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:54 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:54.933587 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:55.036753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-55fdb1fc-7aa2-4f7a-875f-51f07dd63f5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "POST /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.337052 Aug 29 19:10:55.037554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 260/518] 10.222.0.94 () {62 vars in 1364 bytes} [Mon Aug 29 19:10:54 2022] POST /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments => generated 188 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:10:55.169606 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-39b53521-abcc-4800-9ba6-9a81e570b51f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:10:55.170217 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-39b53521-abcc-4800-9ba6-9a81e570b51f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:55.176180 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39b53521-abcc-4800-9ba6-9a81e570b51f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:55.176668 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39b53521-abcc-4800-9ba6-9a81e570b51f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:55.177099 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39b53521-abcc-4800-9ba6-9a81e570b51f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:55.177828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39b53521-abcc-4800-9ba6-9a81e570b51f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:55.178277 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39b53521-abcc-4800-9ba6-9a81e570b51f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:55.178696 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-39b53521-abcc-4800-9ba6-9a81e570b51f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:55.209611 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e3f57a0b-b97a-49ec-bc7b-6e6ca860020d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:55.211315 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e3f57a0b-b97a-49ec-bc7b-6e6ca860020d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:55.218342 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3f57a0b-b97a-49ec-bc7b-6e6ca860020d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:55.219497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3f57a0b-b97a-49ec-bc7b-6e6ca860020d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:55.220154 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3f57a0b-b97a-49ec-bc7b-6e6ca860020d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:55.221326 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3f57a0b-b97a-49ec-bc7b-6e6ca860020d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:55.221996 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3f57a0b-b97a-49ec-bc7b-6e6ca860020d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:55.223516 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3f57a0b-b97a-49ec-bc7b-6e6ca860020d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:55.240766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-39b53521-abcc-4800-9ba6-9a81e570b51f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=115968) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 19:10:55.324480 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-39b53521-abcc-4800-9ba6-9a81e570b51f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "POST /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/action" status: 202 len: 0 microversion: 2.20 time: 0.158990 Aug 29 19:10:55.325002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 259/519] 10.222.0.94 () {62 vars in 1319 bytes} [Mon Aug 29 19:10:55 2022] POST /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:10:55.348811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:55.350067 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:55.357849 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:55.358793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:55.359453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:55.360499 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:55.361144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:55.361801 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:55.508322 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e3f57a0b-b97a-49ec-bc7b-6e6ca860020d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:55.522878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e3f57a0b-b97a-49ec-bc7b-6e6ca860020d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.317690 Aug 29 19:10:55.530194 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 261/520] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:55 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:55.575237 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:55.584127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:55.585575 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:55.586751 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-be849597-3a49-4db2-b372-8e1479372a95 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1809 microversion: 2.20 time: 0.248436 Aug 29 19:10:55.587532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 260/521] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:55 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1809 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:55.828538 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-61b86d13-a471-4bd2-8ba2-4f93674a5b3e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:55.829153 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-61b86d13-a471-4bd2-8ba2-4f93674a5b3e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:55.832446 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:10:55.838406 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61b86d13-a471-4bd2-8ba2-4f93674a5b3e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:55.838839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61b86d13-a471-4bd2-8ba2-4f93674a5b3e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:55.839345 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61b86d13-a471-4bd2-8ba2-4f93674a5b3e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:55.840052 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61b86d13-a471-4bd2-8ba2-4f93674a5b3e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:55.840499 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61b86d13-a471-4bd2-8ba2-4f93674a5b3e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:55.841488 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-61b86d13-a471-4bd2-8ba2-4f93674a5b3e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:56.036658 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-61b86d13-a471-4bd2-8ba2-4f93674a5b3e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:56.050331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-61b86d13-a471-4bd2-8ba2-4f93674a5b3e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.225762 Aug 29 19:10:56.050917 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 262/522] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:55 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:56.545039 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-cb1e0ce7-6095-4bf9-ae9e-43cc09ef8afe tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:56.545624 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-cb1e0ce7-6095-4bf9-ae9e-43cc09ef8afe tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:56.552211 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb1e0ce7-6095-4bf9-ae9e-43cc09ef8afe tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:56.552700 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb1e0ce7-6095-4bf9-ae9e-43cc09ef8afe tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:56.553140 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb1e0ce7-6095-4bf9-ae9e-43cc09ef8afe tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:56.553829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb1e0ce7-6095-4bf9-ae9e-43cc09ef8afe tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:56.554285 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb1e0ce7-6095-4bf9-ae9e-43cc09ef8afe tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:56.554707 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cb1e0ce7-6095-4bf9-ae9e-43cc09ef8afe tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:56.610042 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:56.610681 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:56.616798 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:56.617283 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:56.617729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:56.618492 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:56.618950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:56.619405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:56.745068 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-cb1e0ce7-6095-4bf9-ae9e-43cc09ef8afe tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:56.758713 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-cb1e0ce7-6095-4bf9-ae9e-43cc09ef8afe tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1266 microversion: 2.1 time: 0.217754 Aug 29 19:10:56.759328 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 261/523] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:56 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:56.862569 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:56.871807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:56.873341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:56.874517 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-030b5585-7147-40ed-b2de-fa5df983d994 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1809 microversion: 2.20 time: 0.268751 Aug 29 19:10:56.875098 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 263/524] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:56 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1809 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:10:57.020532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-82bd216c-d989-4945-82c0-074f1043124c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:57.021049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-82bd216c-d989-4945-82c0-074f1043124c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:57.027569 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82bd216c-d989-4945-82c0-074f1043124c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:57.028055 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82bd216c-d989-4945-82c0-074f1043124c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:57.029219 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82bd216c-d989-4945-82c0-074f1043124c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:57.030044 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82bd216c-d989-4945-82c0-074f1043124c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:57.030504 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82bd216c-d989-4945-82c0-074f1043124c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:57.030928 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82bd216c-d989-4945-82c0-074f1043124c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:57.057627 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-82bd216c-d989-4945-82c0-074f1043124c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Going to try to terminate instance {{(pid=115968) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:10:57.069642 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-81009b8b-b431-41a9-acf5-559ce995e322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:57.070638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-81009b8b-b431-41a9-acf5-559ce995e322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:57.077425 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81009b8b-b431-41a9-acf5-559ce995e322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:57.077959 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81009b8b-b431-41a9-acf5-559ce995e322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:57.078334 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81009b8b-b431-41a9-acf5-559ce995e322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:57.079017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81009b8b-b431-41a9-acf5-559ce995e322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:57.079497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81009b8b-b431-41a9-acf5-559ce995e322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:57.079913 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81009b8b-b431-41a9-acf5-559ce995e322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:57.142020 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-82bd216c-d989-4945-82c0-074f1043124c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "DELETE /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 204 len: 0 microversion: 2.1 time: 0.125066 Aug 29 19:10:57.142888 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 262/525] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:10:57 2022] DELETE /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:10:57.151898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-339a3a68-bb5f-4db7-9959-39a5cd31b4c2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:57.152588 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-339a3a68-bb5f-4db7-9959-39a5cd31b4c2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:57.159457 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-339a3a68-bb5f-4db7-9959-39a5cd31b4c2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:57.159942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-339a3a68-bb5f-4db7-9959-39a5cd31b4c2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:57.160616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-339a3a68-bb5f-4db7-9959-39a5cd31b4c2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:57.161322 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-339a3a68-bb5f-4db7-9959-39a5cd31b4c2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:57.161772 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-339a3a68-bb5f-4db7-9959-39a5cd31b4c2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:57.162193 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-339a3a68-bb5f-4db7-9959-39a5cd31b4c2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:57.248197 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-81009b8b-b431-41a9-acf5-559ce995e322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:57.256125 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-81009b8b-b431-41a9-acf5-559ce995e322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.190323 Aug 29 19:10:57.256697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 264/526] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:57 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:57.310400 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-339a3a68-bb5f-4db7-9959-39a5cd31b4c2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:57.318350 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-339a3a68-bb5f-4db7-9959-39a5cd31b4c2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1514 microversion: 2.1 time: 0.170500 Aug 29 19:10:57.318916 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 263/527] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:57 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:57.780160 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bf9d7338-92c9-47b8-854b-bf1302cbdd43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:57.780763 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bf9d7338-92c9-47b8-854b-bf1302cbdd43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:57.787632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf9d7338-92c9-47b8-854b-bf1302cbdd43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:57.788225 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf9d7338-92c9-47b8-854b-bf1302cbdd43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:57.788718 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf9d7338-92c9-47b8-854b-bf1302cbdd43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:57.789447 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf9d7338-92c9-47b8-854b-bf1302cbdd43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:57.789939 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf9d7338-92c9-47b8-854b-bf1302cbdd43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:57.790497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf9d7338-92c9-47b8-854b-bf1302cbdd43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:57.898390 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:57.898943 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:57.906636 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:57.907148 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:57.907582 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:57.908281 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:57.908763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:57.909180 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:58.218366 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-bf9d7338-92c9-47b8-854b-bf1302cbdd43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:58.226087 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bf9d7338-92c9-47b8-854b-bf1302cbdd43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1453 microversion: 2.1 time: 0.450607 Aug 29 19:10:58.226694 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 265/528] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:57 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1453 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:58.229700 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:58.239051 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:58.240555 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:58.241713 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8ccc1978-4d2e-42ea-9d37-3ac3ac1dd28b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1809 microversion: 2.20 time: 0.347612 Aug 29 19:10:58.242340 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 264/529] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:57 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1809 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:10:58.246880 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-561e48c1-71f9-484b-a676-650d5154ce15 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:58.247918 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-561e48c1-71f9-484b-a676-650d5154ce15 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:58.253804 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-561e48c1-71f9-484b-a676-650d5154ce15 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:58.254292 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-561e48c1-71f9-484b-a676-650d5154ce15 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:58.254729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-561e48c1-71f9-484b-a676-650d5154ce15 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:58.255477 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-561e48c1-71f9-484b-a676-650d5154ce15 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:58.255937 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-561e48c1-71f9-484b-a676-650d5154ce15 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:58.256365 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-561e48c1-71f9-484b-a676-650d5154ce15 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:58.277646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-16886749-f028-4733-8bd6-2c9f3e2a6129 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:58.278253 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-16886749-f028-4733-8bd6-2c9f3e2a6129 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:58.284856 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16886749-f028-4733-8bd6-2c9f3e2a6129 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:58.285335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16886749-f028-4733-8bd6-2c9f3e2a6129 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:58.286021 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16886749-f028-4733-8bd6-2c9f3e2a6129 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:58.286705 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16886749-f028-4733-8bd6-2c9f3e2a6129 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:58.287186 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16886749-f028-4733-8bd6-2c9f3e2a6129 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:58.287620 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-16886749-f028-4733-8bd6-2c9f3e2a6129 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:58.433288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-561e48c1-71f9-484b-a676-650d5154ce15 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:58.441324 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-561e48c1-71f9-484b-a676-650d5154ce15 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1453 microversion: 2.1 time: 0.198216 Aug 29 19:10:58.441992 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 266/530] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:58 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:58.446558 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-027222f9-ce12-47bd-ba9f-e5b0b5ae4ab0 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:58.447275 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-027222f9-ce12-47bd-ba9f-e5b0b5ae4ab0 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:58.453630 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-027222f9-ce12-47bd-ba9f-e5b0b5ae4ab0 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:58.454195 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-027222f9-ce12-47bd-ba9f-e5b0b5ae4ab0 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:58.454700 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-027222f9-ce12-47bd-ba9f-e5b0b5ae4ab0 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:58.455509 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-027222f9-ce12-47bd-ba9f-e5b0b5ae4ab0 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:58.456045 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-027222f9-ce12-47bd-ba9f-e5b0b5ae4ab0 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:58.456537 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-027222f9-ce12-47bd-ba9f-e5b0b5ae4ab0 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:58.462548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-16886749-f028-4733-8bd6-2c9f3e2a6129 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:58.473856 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-16886749-f028-4733-8bd6-2c9f3e2a6129 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.199944 Aug 29 19:10:58.475057 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 265/531] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:58 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:58.598958 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-027222f9-ce12-47bd-ba9f-e5b0b5ae4ab0 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:58.607379 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-027222f9-ce12-47bd-ba9f-e5b0b5ae4ab0 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1514 microversion: 2.1 time: 0.163669 Aug 29 19:10:58.607957 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 267/532] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:58 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:10:59.266048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:59.266595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:59.273245 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:59.273735 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:59.274365 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:59.275061 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:59.275549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:59.275978 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:59.409013 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:59.418313 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:59.420207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:59.421534 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-95c7b845-0ef1-42f5-be36-ff3d6d87558d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1809 microversion: 2.20 time: 0.160681 Aug 29 19:10:59.422337 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 266/533] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:10:59 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:10:59.494890 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2656e9f1-fd45-432a-80c2-015eb9ef8e51 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:59.496157 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2656e9f1-fd45-432a-80c2-015eb9ef8e51 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:59.503222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2656e9f1-fd45-432a-80c2-015eb9ef8e51 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:59.503802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2656e9f1-fd45-432a-80c2-015eb9ef8e51 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:59.504309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2656e9f1-fd45-432a-80c2-015eb9ef8e51 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:59.505018 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2656e9f1-fd45-432a-80c2-015eb9ef8e51 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:59.505476 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2656e9f1-fd45-432a-80c2-015eb9ef8e51 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:59.505899 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2656e9f1-fd45-432a-80c2-015eb9ef8e51 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:59.628871 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ee77f82f-aa21-4fad-9562-41c99bbb5fe2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:10:59.629492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ee77f82f-aa21-4fad-9562-41c99bbb5fe2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:10:59.635572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ee77f82f-aa21-4fad-9562-41c99bbb5fe2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:59.636488 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ee77f82f-aa21-4fad-9562-41c99bbb5fe2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:59.636488 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ee77f82f-aa21-4fad-9562-41c99bbb5fe2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:59.637178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ee77f82f-aa21-4fad-9562-41c99bbb5fe2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:10:59.637631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ee77f82f-aa21-4fad-9562-41c99bbb5fe2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:10:59.638751 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ee77f82f-aa21-4fad-9562-41c99bbb5fe2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:10:59.651728 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2656e9f1-fd45-432a-80c2-015eb9ef8e51 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:59.679591 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2656e9f1-fd45-432a-80c2-015eb9ef8e51 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.188567 Aug 29 19:10:59.680369 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 268/534] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:59 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:10:59.789366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ee77f82f-aa21-4fad-9562-41c99bbb5fe2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:10:59.797165 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ee77f82f-aa21-4fad-9562-41c99bbb5fe2 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1514 microversion: 2.1 time: 0.172066 Aug 29 19:10:59.797816 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 267/535] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:10:59 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1514 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:00.364016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-8b9444fb-5169-4336-8693-3be58a70d488 req-63205f25-97c9-47c0-a7b0-9ca5cb0825ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b52e65bd-038e-4fc8-807e-4e4ce60c8db7", "tag": "32fdb103-82cb-4537-9dfe-6532b2639a2a"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:00.375419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-8b9444fb-5169-4336-8693-3be58a70d488 req-63205f25-97c9-47c0-a7b0-9ca5cb0825ee service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:00.376050 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-8b9444fb-5169-4336-8693-3be58a70d488 req-63205f25-97c9-47c0-a7b0-9ca5cb0825ee service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:00.376905 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-8b9444fb-5169-4336-8693-3be58a70d488 req-63205f25-97c9-47c0-a7b0-9ca5cb0825ee service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:00.392583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-8b9444fb-5169-4336-8693-3be58a70d488 req-63205f25-97c9-47c0-a7b0-9ca5cb0825ee service nova] Creating event network-changed:32fdb103-82cb-4537-9dfe-6532b2639a2a for instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 on hv-cinder-73126 Aug 29 19:11:00.397941 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-8b9444fb-5169-4336-8693-3be58a70d488 req-63205f25-97c9-47c0-a7b0-9ca5cb0825ee service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038813 Aug 29 19:11:00.398564 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 269/536] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:00.445892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:00.446539 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:00.454249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:00.454653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:00.455474 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:00.456110 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:00.457356 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:00.457852 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:00.593657 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:00.602412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:00.603886 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:00.605043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-468db6b1-e6d2-4d2b-a57e-56f19e1e68b8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1809 microversion: 2.20 time: 0.163165 Aug 29 19:11:00.605640 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 268/537] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:00 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:00.702203 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3d23bca4-402d-44a6-9fc8-79e687fa3e70 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:00.703992 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3d23bca4-402d-44a6-9fc8-79e687fa3e70 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:00.709799 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d23bca4-402d-44a6-9fc8-79e687fa3e70 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:00.710220 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d23bca4-402d-44a6-9fc8-79e687fa3e70 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:00.710663 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d23bca4-402d-44a6-9fc8-79e687fa3e70 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:00.711392 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d23bca4-402d-44a6-9fc8-79e687fa3e70 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:00.711854 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d23bca4-402d-44a6-9fc8-79e687fa3e70 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:00.712282 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d23bca4-402d-44a6-9fc8-79e687fa3e70 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:00.820054 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-27cf71b3-1a9e-4e43-b6eb-bfa4ef140cf5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:00.820773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-27cf71b3-1a9e-4e43-b6eb-bfa4ef140cf5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:00.829680 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27cf71b3-1a9e-4e43-b6eb-bfa4ef140cf5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:00.838203 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27cf71b3-1a9e-4e43-b6eb-bfa4ef140cf5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:00.838719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27cf71b3-1a9e-4e43-b6eb-bfa4ef140cf5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:00.839560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27cf71b3-1a9e-4e43-b6eb-bfa4ef140cf5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:00.840082 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27cf71b3-1a9e-4e43-b6eb-bfa4ef140cf5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:00.840742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27cf71b3-1a9e-4e43-b6eb-bfa4ef140cf5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:00.848938 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3d23bca4-402d-44a6-9fc8-79e687fa3e70 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:00.856580 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3d23bca4-402d-44a6-9fc8-79e687fa3e70 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.159103 Aug 29 19:11:00.858489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 270/538] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:00 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:00.982045 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-27cf71b3-1a9e-4e43-b6eb-bfa4ef140cf5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:00.990144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-27cf71b3-1a9e-4e43-b6eb-bfa4ef140cf5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1514 microversion: 2.1 time: 0.174724 Aug 29 19:11:00.990715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 269/539] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:00 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:01.629179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:01.629776 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:01.635724 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:01.636230 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:01.636663 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:01.637344 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:01.637951 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:01.638377 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:01.801744 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:01.812538 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:01.814103 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:01.815376 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e5dacf91-c608-4d5f-b8e2-d639c40805d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1809 microversion: 2.20 time: 0.190215 Aug 29 19:11:01.816018 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 271/540] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:01 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:01.877294 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c667a823-93d0-45cc-8d65-29d79af3920e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:01.877906 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c667a823-93d0-45cc-8d65-29d79af3920e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:01.884396 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c667a823-93d0-45cc-8d65-29d79af3920e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:01.884811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c667a823-93d0-45cc-8d65-29d79af3920e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:01.885256 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c667a823-93d0-45cc-8d65-29d79af3920e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:01.885947 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c667a823-93d0-45cc-8d65-29d79af3920e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:01.886406 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c667a823-93d0-45cc-8d65-29d79af3920e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:01.886829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c667a823-93d0-45cc-8d65-29d79af3920e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:02.012388 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-17792dbd-2033-4fa6-802c-1fd4f9653c32 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:02.013333 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-17792dbd-2033-4fa6-802c-1fd4f9653c32 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:02.018601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c667a823-93d0-45cc-8d65-29d79af3920e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:02.019470 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-17792dbd-2033-4fa6-802c-1fd4f9653c32 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:02.019960 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-17792dbd-2033-4fa6-802c-1fd4f9653c32 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:02.020397 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-17792dbd-2033-4fa6-802c-1fd4f9653c32 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:02.021095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-17792dbd-2033-4fa6-802c-1fd4f9653c32 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:02.021552 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-17792dbd-2033-4fa6-802c-1fd4f9653c32 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:02.021976 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-17792dbd-2033-4fa6-802c-1fd4f9653c32 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:02.026470 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c667a823-93d0-45cc-8d65-29d79af3920e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.152998 Aug 29 19:11:02.027053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 270/541] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:01 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:02.155251 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-17792dbd-2033-4fa6-802c-1fd4f9653c32 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:02.163052 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-17792dbd-2033-4fa6-802c-1fd4f9653c32 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1514 microversion: 2.1 time: 0.154813 Aug 29 19:11:02.163636 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 272/542] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:02 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:02.719894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-c14cdb45-3590-4fc7-9875-402e7c1ad177 req-8baa3b20-3a75-452c-8618-db28f81d8196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37f271b-60ea-41f7-86d3-9a324c423afb", "name": "network-vif-deleted", "tag": "e8a3642c-273b-4ca2-98ac-e5056521d7a5"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:02.730888 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-c14cdb45-3590-4fc7-9875-402e7c1ad177 req-8baa3b20-3a75-452c-8618-db28f81d8196 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:02.731782 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-c14cdb45-3590-4fc7-9875-402e7c1ad177 req-8baa3b20-3a75-452c-8618-db28f81d8196 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:02.732472 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-c14cdb45-3590-4fc7-9875-402e7c1ad177 req-8baa3b20-3a75-452c-8618-db28f81d8196 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:02.749631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-c14cdb45-3590-4fc7-9875-402e7c1ad177 req-8baa3b20-3a75-452c-8618-db28f81d8196 service nova] Creating event network-vif-deleted:e8a3642c-273b-4ca2-98ac-e5056521d7a5 for instance b37f271b-60ea-41f7-86d3-9a324c423afb on hv-cinder-73126 Aug 29 19:11:02.758177 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-c14cdb45-3590-4fc7-9875-402e7c1ad177 req-8baa3b20-3a75-452c-8618-db28f81d8196 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043179 Aug 29 19:11:02.758845 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 271/543] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:02.838293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:02.839774 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:02.846350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:02.846858 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:02.847308 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:02.848012 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:02.848473 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:02.848905 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:03.028302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:03.038770 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:03.040381 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:03.041641 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-4e1e5e3d-3cbc-401d-a1ee-57ad6c0de3d3 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1749 microversion: 2.20 time: 0.207336 Aug 29 19:11:03.042208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 273/544] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:02 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1749 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:03.052277 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e98bad3d-2529-470c-aeb6-dcd005e0ad18 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:03.053644 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e98bad3d-2529-470c-aeb6-dcd005e0ad18 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:03.061967 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e98bad3d-2529-470c-aeb6-dcd005e0ad18 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:03.062452 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e98bad3d-2529-470c-aeb6-dcd005e0ad18 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:03.062887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e98bad3d-2529-470c-aeb6-dcd005e0ad18 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:03.063622 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e98bad3d-2529-470c-aeb6-dcd005e0ad18 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:03.064076 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e98bad3d-2529-470c-aeb6-dcd005e0ad18 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:03.064500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e98bad3d-2529-470c-aeb6-dcd005e0ad18 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:03.184113 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:03.184731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:03.191109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:03.191615 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:03.192108 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:03.192816 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:03.193272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:03.193892 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:03.227728 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:03.228396 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:03.228995 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:03.229609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lazy-loading 'fault' on Instance uuid b37f271b-60ea-41f7-86d3-9a324c423afb {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:11:03.307178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e98bad3d-2529-470c-aeb6-dcd005e0ad18 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:03.311822 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:03.315750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e98bad3d-2529-470c-aeb6-dcd005e0ad18 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.270748 Aug 29 19:11:03.316522 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 272/545] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:03 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:03.322947 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2616a7c6-c6cb-47c2-b595-b5b3f7d94a4b tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1309 microversion: 2.1 time: 0.142671 Aug 29 19:11:03.324419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 274/546] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:03 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1309 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:04.067646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:04.068535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:04.072093 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:04.076908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:04.077430 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:04.077874 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:04.078583 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:04.079062 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:04.079665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:04.085284 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:04.223917 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:04.234318 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:04.235832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:04.237011 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0f960059-1a0d-4b96-9920-b3453abdff94 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1751 microversion: 2.20 time: 0.173438 Aug 29 19:11:04.237571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 273/547] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:04 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:04.336350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b8a47ac2-38b5-4bdf-a764-f50b071ab77a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:04.337057 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b8a47ac2-38b5-4bdf-a764-f50b071ab77a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:04.343881 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8a47ac2-38b5-4bdf-a764-f50b071ab77a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:04.344457 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8a47ac2-38b5-4bdf-a764-f50b071ab77a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:04.345134 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8a47ac2-38b5-4bdf-a764-f50b071ab77a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:04.346065 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8a47ac2-38b5-4bdf-a764-f50b071ab77a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:04.346215 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:04.346653 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8a47ac2-38b5-4bdf-a764-f50b071ab77a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:04.347061 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:04.347201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b8a47ac2-38b5-4bdf-a764-f50b071ab77a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:04.353462 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:04.353985 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:04.354429 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:04.355307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:04.355980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:04.356423 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:04.393295 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:04.393295 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:04.393715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:04.394174 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lazy-loading 'fault' on Instance uuid b37f271b-60ea-41f7-86d3-9a324c423afb {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:11:04.459623 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:04.479852 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2215afd1-8c5e-48c2-b883-3f573f3207a1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 200 len: 1309 microversion: 2.1 time: 0.138758 Aug 29 19:11:04.480796 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 274/548] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:04 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 1309 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:04.530948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b8a47ac2-38b5-4bdf-a764-f50b071ab77a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:04.539343 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b8a47ac2-38b5-4bdf-a764-f50b071ab77a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.206992 Aug 29 19:11:04.539923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 275/549] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:04 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:05.261086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:05.261605 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:05.269029 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:05.269518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:05.269954 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:05.270642 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:05.271136 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:05.271559 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:05.401399 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:05.411247 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:05.412744 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:05.413905 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c97e2973-75a5-4146-9970-039dc03c03bd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.156902 Aug 29 19:11:05.414465 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 275/550] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:05 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:05.501493 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:05.502103 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: b37f271b-60ea-41f7-86d3-9a324c423afb] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:05.508405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:05.508889 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:05.509329 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:05.510016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:05.510473 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:05.510902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:05.524324 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] HTTP exception thrown: Instance b37f271b-60ea-41f7-86d3-9a324c423afb could not be found. Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Request method failure captured: Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb HTTP/1.1 Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ7m1LGYIEP7EttH17L1UfI0ySMzsS4MQv5fr1Yr26_rJSrBg8d1h2fyLXOKgWepZXZZ6_oW-usD4jUCST2IsrebQRo5n3HjnQ0bRCtfHvre_vvnQz6IoOBBUBDg08-Wj0clYhysyL9F6JjVY34NaZLXaWgoGjuRGj_Lzs-VkImpiRQ Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 778d0dad05594da5bb3cb0e2efcb2af5 Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457066779 Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:11:05.525948 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/778d0dad05594da5bb3cb0e2efcb2af5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_778d0dad05594da5bb3cb0e2efcb2af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/778d0dad05594da5bb3cb0e2efcb2af5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/778d0dad05594da5bb3cb0e2efcb2af5"}]}] Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-VolumesSnapshotTestJSON-457066779 Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 778d0dad05594da5bb3cb0e2efcb2af5 Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457066779 Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-VolumesSnapshotTestJSON-457066779-project Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 985dfcc7246c45b5b470e07957cd2f49 Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-VolumesSnapshotTestJSON-457066779-project Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance b37f271b-60ea-41f7-86d3-9a324c423afb could not be found. Aug 29 19:11:05.527483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': 'b37f271b-60ea-41f7-86d3-9a324c423afb'} Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b37f271b-60ea-41f7-86d3-9a324c423afb could not be found. Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:11:05.528355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b37f271b-60ea-41f7-86d3-9a324c423afb could not be found. Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b37f271b-60ea-41f7-86d3-9a324c423afb could not be found. Aug 29 19:11:05.530608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:11:05.531972 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Returning 404 to user: Instance b37f271b-60ea-41f7-86d3-9a324c423afb could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:11:05.531972 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8d8c4c48-6a4e-4a7e-866a-566801e943ca tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb" status: 404 len: 111 microversion: 2.1 time: 0.029835 Aug 29 19:11:05.531972 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 276/551] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:05 2022] GET /compute/v2.1/servers/b37f271b-60ea-41f7-86d3-9a324c423afb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:11:05.561857 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c9cea458-ad8c-4e36-9306-8c70ac2d236f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:05.562571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c9cea458-ad8c-4e36-9306-8c70ac2d236f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:05.568750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c9cea458-ad8c-4e36-9306-8c70ac2d236f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:05.569354 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c9cea458-ad8c-4e36-9306-8c70ac2d236f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:05.569844 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c9cea458-ad8c-4e36-9306-8c70ac2d236f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:05.571510 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c9cea458-ad8c-4e36-9306-8c70ac2d236f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:05.571974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c9cea458-ad8c-4e36-9306-8c70ac2d236f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:05.572401 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c9cea458-ad8c-4e36-9306-8c70ac2d236f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:05.782365 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c9cea458-ad8c-4e36-9306-8c70ac2d236f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:05.790471 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c9cea458-ad8c-4e36-9306-8c70ac2d236f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.233790 Aug 29 19:11:05.791055 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 276/552] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:05 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:06.438575 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:06.439148 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:06.446405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:06.447303 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:06.448068 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:06.449287 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:06.450133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:06.450876 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:06.457950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:06.586329 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:06.595668 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:06.597099 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:06.598258 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-169d649c-ac40-43b7-a844-ac068a6ec846 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.164600 Aug 29 19:11:06.598817 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 277/553] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:06 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:06.812048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2251807c-bac0-4931-93db-e364aa38b115 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:06.812723 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2251807c-bac0-4931-93db-e364aa38b115 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:06.819214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2251807c-bac0-4931-93db-e364aa38b115 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:06.819704 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2251807c-bac0-4931-93db-e364aa38b115 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:06.820140 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2251807c-bac0-4931-93db-e364aa38b115 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:06.820877 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2251807c-bac0-4931-93db-e364aa38b115 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:06.821359 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2251807c-bac0-4931-93db-e364aa38b115 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:06.821809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2251807c-bac0-4931-93db-e364aa38b115 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:06.956985 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2251807c-bac0-4931-93db-e364aa38b115 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:06.964698 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2251807c-bac0-4931-93db-e364aa38b115 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.156650 Aug 29 19:11:06.965264 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 277/554] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:06 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:07.621422 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:07.622037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:07.629161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:07.629651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:07.630088 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:07.630790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:07.631310 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:07.631742 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:07.762849 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:07.772429 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:07.773914 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:07.775134 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7f77bfc8-46f0-4e25-84b1-0f6fd24a4309 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.157686 Aug 29 19:11:07.775700 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 278/555] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:07 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:07.985926 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-95a0ce38-4593-4d81-8be9-39732fa8aa46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:07.986462 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-95a0ce38-4593-4d81-8be9-39732fa8aa46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:07.992896 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95a0ce38-4593-4d81-8be9-39732fa8aa46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:07.993380 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95a0ce38-4593-4d81-8be9-39732fa8aa46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:07.993811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95a0ce38-4593-4d81-8be9-39732fa8aa46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:07.994505 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95a0ce38-4593-4d81-8be9-39732fa8aa46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:07.995014 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95a0ce38-4593-4d81-8be9-39732fa8aa46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:07.995409 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-95a0ce38-4593-4d81-8be9-39732fa8aa46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:08.125518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-95a0ce38-4593-4d81-8be9-39732fa8aa46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:08.133356 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-95a0ce38-4593-4d81-8be9-39732fa8aa46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.151980 Aug 29 19:11:08.133941 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 278/556] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:07 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:08.800593 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:08.801594 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:08.809770 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:08.810182 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:08.810626 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:08.811350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:08.812403 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:08.812814 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:08.945854 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:08.954451 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:08.955929 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:08.957087 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-00139878-0df1-43ac-8f13-2588163d9d75 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.162674 Aug 29 19:11:08.957844 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 279/557] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:08 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:09.154026 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-75eb44cc-b5ed-4afc-bd2e-c1573b5a7f21 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:09.154575 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-75eb44cc-b5ed-4afc-bd2e-c1573b5a7f21 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:09.162464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75eb44cc-b5ed-4afc-bd2e-c1573b5a7f21 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:09.162947 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75eb44cc-b5ed-4afc-bd2e-c1573b5a7f21 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:09.163476 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75eb44cc-b5ed-4afc-bd2e-c1573b5a7f21 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:09.164406 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75eb44cc-b5ed-4afc-bd2e-c1573b5a7f21 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:09.164711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75eb44cc-b5ed-4afc-bd2e-c1573b5a7f21 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:09.165131 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75eb44cc-b5ed-4afc-bd2e-c1573b5a7f21 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:09.301624 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-75eb44cc-b5ed-4afc-bd2e-c1573b5a7f21 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:09.309796 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-75eb44cc-b5ed-4afc-bd2e-c1573b5a7f21 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.159699 Aug 29 19:11:09.310368 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 279/558] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:09 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:09.980633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:09.981341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:09.988280 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:09.988781 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:09.989202 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:09.989851 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:09.990314 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:09.990745 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:10.127698 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:10.136414 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:10.137929 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:10.139112 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e6bc8786-89fc-4dc1-b643-66db6d7b34f8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.162325 Aug 29 19:11:10.139687 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 280/559] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:09 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:10.330832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-24c4da2b-b5c8-409d-9ac5-c9d3041ef99e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:10.331485 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-24c4da2b-b5c8-409d-9ac5-c9d3041ef99e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:10.338082 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24c4da2b-b5c8-409d-9ac5-c9d3041ef99e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:10.338570 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24c4da2b-b5c8-409d-9ac5-c9d3041ef99e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:10.339002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24c4da2b-b5c8-409d-9ac5-c9d3041ef99e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:10.339911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24c4da2b-b5c8-409d-9ac5-c9d3041ef99e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:10.340922 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24c4da2b-b5c8-409d-9ac5-c9d3041ef99e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:10.341361 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-24c4da2b-b5c8-409d-9ac5-c9d3041ef99e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:10.522523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-24c4da2b-b5c8-409d-9ac5-c9d3041ef99e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:10.541903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-24c4da2b-b5c8-409d-9ac5-c9d3041ef99e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.214922 Aug 29 19:11:10.542662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 280/560] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:10 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:11.162104 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:11.163837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:11.172516 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:11.173344 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:11.173790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:11.174559 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:11.175051 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:11.175663 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:11.348891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:11.357471 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:11.359747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:11.360840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f563698f-ed7c-476c-b570-912aa20ebce7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.202851 Aug 29 19:11:11.361404 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 281/561] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:11 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:11.567015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2d6a02de-a04f-4138-84d8-d2bb06af0ef6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:11.567981 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2d6a02de-a04f-4138-84d8-d2bb06af0ef6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:11.575098 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2d6a02de-a04f-4138-84d8-d2bb06af0ef6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:11.575731 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2d6a02de-a04f-4138-84d8-d2bb06af0ef6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:11.576227 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2d6a02de-a04f-4138-84d8-d2bb06af0ef6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:11.576926 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2d6a02de-a04f-4138-84d8-d2bb06af0ef6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:11.577410 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2d6a02de-a04f-4138-84d8-d2bb06af0ef6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:11.578552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2d6a02de-a04f-4138-84d8-d2bb06af0ef6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:11.723426 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2d6a02de-a04f-4138-84d8-d2bb06af0ef6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:11.732701 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2d6a02de-a04f-4138-84d8-d2bb06af0ef6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.171056 Aug 29 19:11:11.733306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 281/562] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:11 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:12.385841 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:12.386480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:12.393456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:12.393941 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:12.394376 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:12.395063 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:12.395543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:12.395969 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:12.550275 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:12.558139 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:12.559631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:12.560795 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2bf7a70f-0291-49b6-8daf-f423af5fc349 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.178846 Aug 29 19:11:12.561359 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 282/563] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:12 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:12.754967 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-05b2cf53-c2d5-47a4-a390-f16f363a3bc1 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:12.755645 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-05b2cf53-c2d5-47a4-a390-f16f363a3bc1 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:12.762063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b2cf53-c2d5-47a4-a390-f16f363a3bc1 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:12.762542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b2cf53-c2d5-47a4-a390-f16f363a3bc1 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:12.762980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b2cf53-c2d5-47a4-a390-f16f363a3bc1 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:12.763689 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b2cf53-c2d5-47a4-a390-f16f363a3bc1 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:12.764149 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b2cf53-c2d5-47a4-a390-f16f363a3bc1 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:12.764571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05b2cf53-c2d5-47a4-a390-f16f363a3bc1 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:12.908527 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-05b2cf53-c2d5-47a4-a390-f16f363a3bc1 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:12.916653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-05b2cf53-c2d5-47a4-a390-f16f363a3bc1 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.165667 Aug 29 19:11:12.917764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 282/564] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:12 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:13.585697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:13.586996 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:13.593654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:13.601992 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:13.602875 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:13.604321 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:13.608201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:13.609703 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:13.770574 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:13.780371 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:13.781851 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:13.783023 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0b4f1cb7-bbb5-496c-bff4-b6afa02042af tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.202226 Aug 29 19:11:13.783664 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 283/565] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:13 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:13.938632 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-00144ba1-08a2-4696-9fcb-22cc47390a5b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:13.939359 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-00144ba1-08a2-4696-9fcb-22cc47390a5b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:13.945945 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00144ba1-08a2-4696-9fcb-22cc47390a5b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:13.946466 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00144ba1-08a2-4696-9fcb-22cc47390a5b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:13.946911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00144ba1-08a2-4696-9fcb-22cc47390a5b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:13.947649 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00144ba1-08a2-4696-9fcb-22cc47390a5b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:13.948298 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00144ba1-08a2-4696-9fcb-22cc47390a5b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:13.948873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00144ba1-08a2-4696-9fcb-22cc47390a5b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:14.091907 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-00144ba1-08a2-4696-9fcb-22cc47390a5b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:14.100499 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-00144ba1-08a2-4696-9fcb-22cc47390a5b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.166515 Aug 29 19:11:14.101091 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 283/566] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:13 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:14.806501 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:14.807169 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:14.814370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:14.814854 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:14.815338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:14.816024 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:14.816478 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:14.816902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:14.992226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:15.003205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:15.005033 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:15.006768 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a2da6cf6-6e64-4118-80de-9f8d7ec9214b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.204000 Aug 29 19:11:15.019934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 284/567] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:14 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:15.121353 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7d2bef64-303c-4252-aab4-a326adb83b92 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:15.121994 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7d2bef64-303c-4252-aab4-a326adb83b92 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:15.129754 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d2bef64-303c-4252-aab4-a326adb83b92 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:15.130528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d2bef64-303c-4252-aab4-a326adb83b92 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:15.131505 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d2bef64-303c-4252-aab4-a326adb83b92 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:15.132609 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d2bef64-303c-4252-aab4-a326adb83b92 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:15.133229 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d2bef64-303c-4252-aab4-a326adb83b92 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:15.133802 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d2bef64-303c-4252-aab4-a326adb83b92 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:15.274601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7d2bef64-303c-4252-aab4-a326adb83b92 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:15.283218 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7d2bef64-303c-4252-aab4-a326adb83b92 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.165700 Aug 29 19:11:15.283796 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 284/568] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:15 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:15.509085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1998001599", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "networks": [{"uuid": "52476fb5-9ab9-4464-9daf-e0ff6b32722a"}]}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:15.565649 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] validate_networks() for [('52476fb5-9ab9-4464-9daf-e0ff6b32722a', None, None, None, None, None)] {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:11:15.941248 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:11:15.941835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:11:15.942124 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:11:15.942530 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:11:15.942940 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:11:15.951995 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:15.953087 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:15.953848 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:15.954576 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:15.955032 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:15.955479 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:15.972484 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Getting quotas for project 778d0dad05594da5bb3cb0e2efcb2af5. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:11:15.976616 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Getting quotas for user 985dfcc7246c45b5b470e07957cd2f49 and project 778d0dad05594da5bb3cb0e2efcb2af5. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:11:15.988952 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:11:15.991329 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:11:16.032044 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:16.032801 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:16.039048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:16.039563 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:16.040127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:16.040700 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:16.041161 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:16.041579 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:16.043995 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-03267a6e-6fa5-4991-a0c6-60f7b863458f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538561 Aug 29 19:11:16.051656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 285/569] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:11:16.056880 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c1cbfe2c-82f4-4ebe-b2b3-3588205ec859 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:16.057491 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c1cbfe2c-82f4-4ebe-b2b3-3588205ec859 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:16.155423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c1cbfe2c-82f4-4ebe-b2b3-3588205ec859 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:16.165338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c1cbfe2c-82f4-4ebe-b2b3-3588205ec859 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1219 microversion: 2.1 time: 0.111333 Aug 29 19:11:16.166161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 286/570] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:16 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:16.242892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:16.252995 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:16.254514 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:16.255799 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0dfccec0-a5ae-49c5-b7b7-77170b56af76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.227705 Aug 29 19:11:16.256380 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 285/571] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:16 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:16.304711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-09e2294f-cd85-4d2a-a648-99dab9a2abfb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:16.305327 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-09e2294f-cd85-4d2a-a648-99dab9a2abfb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:16.313529 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-09e2294f-cd85-4d2a-a648-99dab9a2abfb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:16.314208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-09e2294f-cd85-4d2a-a648-99dab9a2abfb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:16.314681 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-09e2294f-cd85-4d2a-a648-99dab9a2abfb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:16.318633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-09e2294f-cd85-4d2a-a648-99dab9a2abfb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:16.318633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-09e2294f-cd85-4d2a-a648-99dab9a2abfb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:16.318633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-09e2294f-cd85-4d2a-a648-99dab9a2abfb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:16.497991 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-09e2294f-cd85-4d2a-a648-99dab9a2abfb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:16.508218 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-09e2294f-cd85-4d2a-a648-99dab9a2abfb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.207183 Aug 29 19:11:16.508852 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 287/572] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:16 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:16.653871 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-ce990699-4009-4d74-8cd9-f5c226221790 req-dc1bafbe-dabc-4891-a13a-ab8c83b973b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337970a7-0d96-4590-bbf0-e7e1b2fae6ac", "name": "network-vif-plugged", "status": "completed", "tag": "bc2fe8d5-1c6f-407b-8613-774dc48866ca"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:16.664730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ce990699-4009-4d74-8cd9-f5c226221790 req-dc1bafbe-dabc-4891-a13a-ab8c83b973b5 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:16.665222 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ce990699-4009-4d74-8cd9-f5c226221790 req-dc1bafbe-dabc-4891-a13a-ab8c83b973b5 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:16.665654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ce990699-4009-4d74-8cd9-f5c226221790 req-dc1bafbe-dabc-4891-a13a-ab8c83b973b5 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:16.685367 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-ce990699-4009-4d74-8cd9-f5c226221790 req-dc1bafbe-dabc-4891-a13a-ab8c83b973b5 service nova] Creating event network-vif-plugged:bc2fe8d5-1c6f-407b-8613-774dc48866ca for instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac on hv-cinder-73126 Aug 29 19:11:16.701673 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-ce990699-4009-4d74-8cd9-f5c226221790 req-dc1bafbe-dabc-4891-a13a-ab8c83b973b5 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051261 Aug 29 19:11:16.702640 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 286/573] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:17.188439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b58bd4ee-2355-4c18-a7dc-e6c4aac099c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:17.189085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b58bd4ee-2355-4c18-a7dc-e6c4aac099c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:17.195505 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b58bd4ee-2355-4c18-a7dc-e6c4aac099c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:17.196069 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b58bd4ee-2355-4c18-a7dc-e6c4aac099c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:17.196550 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b58bd4ee-2355-4c18-a7dc-e6c4aac099c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:17.197310 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b58bd4ee-2355-4c18-a7dc-e6c4aac099c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:17.197776 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b58bd4ee-2355-4c18-a7dc-e6c4aac099c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:17.198339 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b58bd4ee-2355-4c18-a7dc-e6c4aac099c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:17.263659 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b58bd4ee-2355-4c18-a7dc-e6c4aac099c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:17.272414 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b58bd4ee-2355-4c18-a7dc-e6c4aac099c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1223 microversion: 2.1 time: 0.087891 Aug 29 19:11:17.272988 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 288/574] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:17 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:17.282390 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:17.283708 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:17.290438 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:17.291275 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:17.291806 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:17.292507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:17.292968 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:17.293575 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:17.439300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:17.450624 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:17.452099 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:17.453343 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2928d09e-66d6-42d9-843d-8818b51077c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.176477 Aug 29 19:11:17.453903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 287/575] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:17 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:17.533086 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-78b082ec-170c-412d-9f25-21b35446091a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:17.533698 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-78b082ec-170c-412d-9f25-21b35446091a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:17.539940 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78b082ec-170c-412d-9f25-21b35446091a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:17.540442 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78b082ec-170c-412d-9f25-21b35446091a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:17.540914 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78b082ec-170c-412d-9f25-21b35446091a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:17.541666 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78b082ec-170c-412d-9f25-21b35446091a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:17.542122 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78b082ec-170c-412d-9f25-21b35446091a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:17.542550 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78b082ec-170c-412d-9f25-21b35446091a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:17.685792 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-78b082ec-170c-412d-9f25-21b35446091a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:17.695539 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-78b082ec-170c-412d-9f25-21b35446091a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.166951 Aug 29 19:11:17.696314 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 289/576] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:17 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:18.294059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6df2bf83-6e3c-4ee1-b36c-b4d7181ef7c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:18.294653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6df2bf83-6e3c-4ee1-b36c-b4d7181ef7c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:18.301878 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6df2bf83-6e3c-4ee1-b36c-b4d7181ef7c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:18.302357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6df2bf83-6e3c-4ee1-b36c-b4d7181ef7c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:18.302789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6df2bf83-6e3c-4ee1-b36c-b4d7181ef7c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:18.303504 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6df2bf83-6e3c-4ee1-b36c-b4d7181ef7c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:18.303964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6df2bf83-6e3c-4ee1-b36c-b4d7181ef7c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:18.304384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6df2bf83-6e3c-4ee1-b36c-b4d7181ef7c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:18.372697 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6df2bf83-6e3c-4ee1-b36c-b4d7181ef7c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:18.381240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6df2bf83-6e3c-4ee1-b36c-b4d7181ef7c5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1223 microversion: 2.1 time: 0.090998 Aug 29 19:11:18.381814 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 288/577] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:18 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:18.484590 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:18.486914 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:18.493951 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:18.494733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:18.495391 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:18.496126 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:18.496583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:18.497032 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:18.639502 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:18.651026 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:18.652496 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:18.653658 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c0b08388-0fce-4618-94e6-2808b2ccb31b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.173968 Aug 29 19:11:18.654217 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 290/578] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:18 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:18.725158 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d28f7738-795a-4252-a7ee-365b82fbe6bb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:18.725948 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d28f7738-795a-4252-a7ee-365b82fbe6bb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:18.732468 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d28f7738-795a-4252-a7ee-365b82fbe6bb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:18.732957 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d28f7738-795a-4252-a7ee-365b82fbe6bb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:18.733397 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d28f7738-795a-4252-a7ee-365b82fbe6bb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:18.734780 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d28f7738-795a-4252-a7ee-365b82fbe6bb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:18.735356 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d28f7738-795a-4252-a7ee-365b82fbe6bb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:18.735792 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d28f7738-795a-4252-a7ee-365b82fbe6bb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:18.879799 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d28f7738-795a-4252-a7ee-365b82fbe6bb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:18.887453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d28f7738-795a-4252-a7ee-365b82fbe6bb tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.166345 Aug 29 19:11:18.888026 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 289/579] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:18 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:19.402422 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cd92b03d-81f7-428e-945b-2ff73e278d1e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:19.403031 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cd92b03d-81f7-428e-945b-2ff73e278d1e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:19.409657 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd92b03d-81f7-428e-945b-2ff73e278d1e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:19.410140 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd92b03d-81f7-428e-945b-2ff73e278d1e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:19.410691 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd92b03d-81f7-428e-945b-2ff73e278d1e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:19.411691 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd92b03d-81f7-428e-945b-2ff73e278d1e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:19.412154 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd92b03d-81f7-428e-945b-2ff73e278d1e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:19.412603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd92b03d-81f7-428e-945b-2ff73e278d1e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:19.484423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cd92b03d-81f7-428e-945b-2ff73e278d1e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:19.492812 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cd92b03d-81f7-428e-945b-2ff73e278d1e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1223 microversion: 2.1 time: 0.094281 Aug 29 19:11:19.503552 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 291/580] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:19 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:19.678207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:19.679768 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:19.686974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:19.687934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:19.688646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:19.689647 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:19.690213 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:19.694399 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:19.699544 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:19.842256 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:19.851972 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:19.853540 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:19.855384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-33d2c098-f0b9-4905-a705-dd2d9fcaa583 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.180458 Aug 29 19:11:19.867568 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 290/581] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:19 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:19.909777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b16a73b9-9a1a-4df2-91ce-238bffd0f7a8 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:19.910318 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b16a73b9-9a1a-4df2-91ce-238bffd0f7a8 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:19.917159 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b16a73b9-9a1a-4df2-91ce-238bffd0f7a8 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:19.917656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b16a73b9-9a1a-4df2-91ce-238bffd0f7a8 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:19.918098 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b16a73b9-9a1a-4df2-91ce-238bffd0f7a8 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:19.918806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b16a73b9-9a1a-4df2-91ce-238bffd0f7a8 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:19.919296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b16a73b9-9a1a-4df2-91ce-238bffd0f7a8 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:19.919724 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b16a73b9-9a1a-4df2-91ce-238bffd0f7a8 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:20.070950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b16a73b9-9a1a-4df2-91ce-238bffd0f7a8 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:20.079049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b16a73b9-9a1a-4df2-91ce-238bffd0f7a8 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.173915 Aug 29 19:11:20.079854 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 292/582] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:19 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:20.513668 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8e1c03e9-d82f-4e45-947f-1ed767b97d14 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:20.514281 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8e1c03e9-d82f-4e45-947f-1ed767b97d14 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:20.520477 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e1c03e9-d82f-4e45-947f-1ed767b97d14 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:20.520962 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e1c03e9-d82f-4e45-947f-1ed767b97d14 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:20.521399 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e1c03e9-d82f-4e45-947f-1ed767b97d14 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:20.522084 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e1c03e9-d82f-4e45-947f-1ed767b97d14 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:20.522540 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e1c03e9-d82f-4e45-947f-1ed767b97d14 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:20.522964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e1c03e9-d82f-4e45-947f-1ed767b97d14 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:20.588017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8e1c03e9-d82f-4e45-947f-1ed767b97d14 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:20.596111 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8e1c03e9-d82f-4e45-947f-1ed767b97d14 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1223 microversion: 2.1 time: 0.086249 Aug 29 19:11:20.596772 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 291/583] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:20 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:20.879055 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:20.879689 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:20.885645 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:20.886066 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:20.886518 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:20.887225 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:20.887710 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:20.888134 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:21.019937 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:21.028730 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:21.030338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:21.032127 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cce3aa53-2c5a-4a9a-9e35-584d1d509e2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.157017 Aug 29 19:11:21.032697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 293/584] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:20 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:21.100214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-61577212-c6c3-42e5-ae06-b31f98eea21f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:21.100826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-61577212-c6c3-42e5-ae06-b31f98eea21f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:21.107270 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61577212-c6c3-42e5-ae06-b31f98eea21f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:21.107763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61577212-c6c3-42e5-ae06-b31f98eea21f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:21.108203 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61577212-c6c3-42e5-ae06-b31f98eea21f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:21.108989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61577212-c6c3-42e5-ae06-b31f98eea21f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:21.109445 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61577212-c6c3-42e5-ae06-b31f98eea21f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:21.109873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61577212-c6c3-42e5-ae06-b31f98eea21f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:21.242851 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-61577212-c6c3-42e5-ae06-b31f98eea21f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:21.251678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-61577212-c6c3-42e5-ae06-b31f98eea21f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.155087 Aug 29 19:11:21.252146 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 292/585] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:21 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:21.616941 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8f55a7ff-170d-4229-b22c-a1e9b9e9f1c1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:21.617546 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8f55a7ff-170d-4229-b22c-a1e9b9e9f1c1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:21.623508 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f55a7ff-170d-4229-b22c-a1e9b9e9f1c1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:21.623986 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f55a7ff-170d-4229-b22c-a1e9b9e9f1c1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:21.625228 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f55a7ff-170d-4229-b22c-a1e9b9e9f1c1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:21.625808 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f55a7ff-170d-4229-b22c-a1e9b9e9f1c1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:21.626258 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f55a7ff-170d-4229-b22c-a1e9b9e9f1c1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:21.626684 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8f55a7ff-170d-4229-b22c-a1e9b9e9f1c1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:21.689710 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8f55a7ff-170d-4229-b22c-a1e9b9e9f1c1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:21.701017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8f55a7ff-170d-4229-b22c-a1e9b9e9f1c1 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1215 microversion: 2.1 time: 0.087678 Aug 29 19:11:21.701850 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 294/586] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:21 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:22.055701 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:22.056309 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:22.062414 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:22.063025 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:22.063368 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:22.064066 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:22.065715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:22.065715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:22.261826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:22.271986 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:22.273540 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:22.273772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f9c69e10-781e-46ed-ac34-f42613afcc54 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:22.274675 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e0a9a6b7-a71d-4e5d-9a76-796340fe757a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.223031 Aug 29 19:11:22.274989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f9c69e10-781e-46ed-ac34-f42613afcc54 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:22.275253 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 293/587] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:22 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:22.281726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9c69e10-781e-46ed-ac34-f42613afcc54 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:22.282452 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9c69e10-781e-46ed-ac34-f42613afcc54 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:22.282883 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9c69e10-781e-46ed-ac34-f42613afcc54 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:22.283620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9c69e10-781e-46ed-ac34-f42613afcc54 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:22.284104 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9c69e10-781e-46ed-ac34-f42613afcc54 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:22.284518 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9c69e10-781e-46ed-ac34-f42613afcc54 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:22.303004 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:22.432348 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f9c69e10-781e-46ed-ac34-f42613afcc54 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:22.440456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f9c69e10-781e-46ed-ac34-f42613afcc54 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.170920 Aug 29 19:11:22.441028 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 295/588] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:22 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:22.721754 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-78f60d2e-96fa-4fe5-be1e-60458a1f27c3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:22.722384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-78f60d2e-96fa-4fe5-be1e-60458a1f27c3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:22.728309 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78f60d2e-96fa-4fe5-be1e-60458a1f27c3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:22.728786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78f60d2e-96fa-4fe5-be1e-60458a1f27c3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:22.729213 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78f60d2e-96fa-4fe5-be1e-60458a1f27c3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:22.729885 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78f60d2e-96fa-4fe5-be1e-60458a1f27c3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:22.730333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78f60d2e-96fa-4fe5-be1e-60458a1f27c3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:22.730749 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78f60d2e-96fa-4fe5-be1e-60458a1f27c3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:22.791231 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-78f60d2e-96fa-4fe5-be1e-60458a1f27c3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:22.799178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-78f60d2e-96fa-4fe5-be1e-60458a1f27c3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1271 microversion: 2.1 time: 0.081386 Aug 29 19:11:22.799757 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 294/589] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:22 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:23.299225 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:23.299832 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:23.305816 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:23.306299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:23.306734 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:23.307479 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:23.307935 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:23.308358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:23.446029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:23.456288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:23.458048 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:23.459345 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-67c99789-3ed4-4885-a21e-a712a682b63d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.164711 Aug 29 19:11:23.460200 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 296/590] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:23 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:23.461172 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2576ee9d-d4a8-4e69-a7a6-52cdf027656b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:23.461793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2576ee9d-d4a8-4e69-a7a6-52cdf027656b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:23.469592 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2576ee9d-d4a8-4e69-a7a6-52cdf027656b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:23.469811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2576ee9d-d4a8-4e69-a7a6-52cdf027656b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:23.470259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2576ee9d-d4a8-4e69-a7a6-52cdf027656b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:23.470953 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2576ee9d-d4a8-4e69-a7a6-52cdf027656b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:23.471453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2576ee9d-d4a8-4e69-a7a6-52cdf027656b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:23.471879 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2576ee9d-d4a8-4e69-a7a6-52cdf027656b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:23.601742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2576ee9d-d4a8-4e69-a7a6-52cdf027656b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:23.609571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2576ee9d-d4a8-4e69-a7a6-52cdf027656b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1260 microversion: 2.1 time: 0.152158 Aug 29 19:11:23.610139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 295/591] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:23 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:23.819731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1e16d16c-aeb7-420f-8c4f-0812e4a69926 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:23.820346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1e16d16c-aeb7-420f-8c4f-0812e4a69926 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:23.826289 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e16d16c-aeb7-420f-8c4f-0812e4a69926 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:23.826789 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e16d16c-aeb7-420f-8c4f-0812e4a69926 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:23.827240 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e16d16c-aeb7-420f-8c4f-0812e4a69926 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:23.827933 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e16d16c-aeb7-420f-8c4f-0812e4a69926 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:23.828399 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e16d16c-aeb7-420f-8c4f-0812e4a69926 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:23.828825 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e16d16c-aeb7-420f-8c4f-0812e4a69926 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:23.890561 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1e16d16c-aeb7-420f-8c4f-0812e4a69926 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:23.898106 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1e16d16c-aeb7-420f-8c4f-0812e4a69926 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1271 microversion: 2.1 time: 0.082263 Aug 29 19:11:23.898661 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 297/592] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:23 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:24.485054 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:24.485656 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:24.492116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:24.492594 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:24.493028 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:24.493709 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:24.494155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:24.494570 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:24.627242 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:24.630064 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6b24ad3a-03e9-4cbd-bca6-ee13ec3c54c3 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:24.630790 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6b24ad3a-03e9-4cbd-bca6-ee13ec3c54c3 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:24.635946 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:24.636763 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6b24ad3a-03e9-4cbd-bca6-ee13ec3c54c3 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:24.637312 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6b24ad3a-03e9-4cbd-bca6-ee13ec3c54c3 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:24.637428 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:24.637886 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6b24ad3a-03e9-4cbd-bca6-ee13ec3c54c3 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:24.638538 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d7fc2c9c-5ab3-4cee-abf9-0850f4a0fb23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.158111 Aug 29 19:11:24.638681 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6b24ad3a-03e9-4cbd-bca6-ee13ec3c54c3 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:24.639119 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 296/593] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:24 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:24.639259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6b24ad3a-03e9-4cbd-bca6-ee13ec3c54c3 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:24.639750 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6b24ad3a-03e9-4cbd-bca6-ee13ec3c54c3 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:24.775715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6b24ad3a-03e9-4cbd-bca6-ee13ec3c54c3 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:24.784321 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6b24ad3a-03e9-4cbd-bca6-ee13ec3c54c3 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1444 microversion: 2.1 time: 0.158333 Aug 29 19:11:24.784977 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 298/594] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:24 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:24.805109 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e4acbb19-6c8c-4a9f-980d-095c4f80c921 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:24.806010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e4acbb19-6c8c-4a9f-980d-095c4f80c921 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:24.812227 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4acbb19-6c8c-4a9f-980d-095c4f80c921 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:24.812604 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4acbb19-6c8c-4a9f-980d-095c4f80c921 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:24.813293 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4acbb19-6c8c-4a9f-980d-095c4f80c921 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:24.813998 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4acbb19-6c8c-4a9f-980d-095c4f80c921 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:24.814478 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4acbb19-6c8c-4a9f-980d-095c4f80c921 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:24.814911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e4acbb19-6c8c-4a9f-980d-095c4f80c921 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:24.922400 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0d4c2393-bfb0-4aa6-b6b5-1528ab78f0b3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:24.923260 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0d4c2393-bfb0-4aa6-b6b5-1528ab78f0b3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:24.934797 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0d4c2393-bfb0-4aa6-b6b5-1528ab78f0b3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:24.935035 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0d4c2393-bfb0-4aa6-b6b5-1528ab78f0b3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:24.937375 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0d4c2393-bfb0-4aa6-b6b5-1528ab78f0b3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:24.938386 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0d4c2393-bfb0-4aa6-b6b5-1528ab78f0b3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:24.938868 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0d4c2393-bfb0-4aa6-b6b5-1528ab78f0b3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:24.939487 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0d4c2393-bfb0-4aa6-b6b5-1528ab78f0b3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:25.027911 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0d4c2393-bfb0-4aa6-b6b5-1528ab78f0b3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:25.035700 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0d4c2393-bfb0-4aa6-b6b5-1528ab78f0b3 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1289 microversion: 2.1 time: 0.119851 Aug 29 19:11:25.036267 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 299/595] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:24 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1289 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:25.064870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e4acbb19-6c8c-4a9f-980d-095c4f80c921 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:25.072534 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e4acbb19-6c8c-4a9f-980d-095c4f80c921 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1444 microversion: 2.1 time: 0.271344 Aug 29 19:11:25.073093 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 297/596] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:24 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1444 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:25.663096 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:25.664071 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:25.670556 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:25.671286 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:25.672123 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:25.672903 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:25.673687 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:25.674417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:25.963643 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:26.059270 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c1e2a264-c288-420c-8be6-db6e2a320c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:26.060794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c1e2a264-c288-420c-8be6-db6e2a320c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:26.071305 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c1e2a264-c288-420c-8be6-db6e2a320c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:26.071927 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c1e2a264-c288-420c-8be6-db6e2a320c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:26.072462 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c1e2a264-c288-420c-8be6-db6e2a320c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:26.073386 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c1e2a264-c288-420c-8be6-db6e2a320c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:26.073845 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c1e2a264-c288-420c-8be6-db6e2a320c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:26.074266 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c1e2a264-c288-420c-8be6-db6e2a320c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:26.118319 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:26.130224 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:26.131699 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:26.133594 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cab90724-8e7e-4832-ac50-b2a5923771f2 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.474779 Aug 29 19:11:26.134165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 300/597] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:25 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:26.321434 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c1e2a264-c288-420c-8be6-db6e2a320c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:26.329418 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c1e2a264-c288-420c-8be6-db6e2a320c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.275796 Aug 29 19:11:26.330338 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 298/598] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:26 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:26.730434 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-fecd44f0-ecfe-4428-82ad-257e7a4b9454 req-64a3bd99-d4a1-4ebd-aa59-b97bc39346ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "693efce1-e294-4292-9e4c-289b5a18e7e7", "tag": "97d1e245-1b7b-4037-8040-3f51dfe1009e"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:26.741259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=8 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:26.742793 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:26.745751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-fecd44f0-ecfe-4428-82ad-257e7a4b9454 req-64a3bd99-d4a1-4ebd-aa59-b97bc39346ed service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:26.746510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-fecd44f0-ecfe-4428-82ad-257e7a4b9454 req-64a3bd99-d4a1-4ebd-aa59-b97bc39346ed service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:26.747149 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-fecd44f0-ecfe-4428-82ad-257e7a4b9454 req-64a3bd99-d4a1-4ebd-aa59-b97bc39346ed service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:26.762910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-fecd44f0-ecfe-4428-82ad-257e7a4b9454 req-64a3bd99-d4a1-4ebd-aa59-b97bc39346ed service nova] Creating event network-changed:97d1e245-1b7b-4037-8040-3f51dfe1009e for instance 693efce1-e294-4292-9e4c-289b5a18e7e7 on hv-cinder-73126 Aug 29 19:11:26.769406 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-fecd44f0-ecfe-4428-82ad-257e7a4b9454 req-64a3bd99-d4a1-4ebd-aa59-b97bc39346ed service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042663 Aug 29 19:11:26.770020 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 301/599] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:26.918303 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-507adf72-ac10-4dea-b113-f122ca7dad69 req-79d250b1-d864-49ae-97ed-fbae3d1a139f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337970a7-0d96-4590-bbf0-e7e1b2fae6ac", "tag": "bc2fe8d5-1c6f-407b-8613-774dc48866ca"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:26.929893 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-507adf72-ac10-4dea-b113-f122ca7dad69 req-79d250b1-d864-49ae-97ed-fbae3d1a139f service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:26.930508 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-507adf72-ac10-4dea-b113-f122ca7dad69 req-79d250b1-d864-49ae-97ed-fbae3d1a139f service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:26.930980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-507adf72-ac10-4dea-b113-f122ca7dad69 req-79d250b1-d864-49ae-97ed-fbae3d1a139f service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:26.943883 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-507adf72-ac10-4dea-b113-f122ca7dad69 req-79d250b1-d864-49ae-97ed-fbae3d1a139f service nova] Creating event network-changed:bc2fe8d5-1c6f-407b-8613-774dc48866ca for instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac on hv-cinder-73126 Aug 29 19:11:26.949103 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-507adf72-ac10-4dea-b113-f122ca7dad69 req-79d250b1-d864-49ae-97ed-fbae3d1a139f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034761 Aug 29 19:11:26.950136 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 299/600] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:27.159426 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:27.160033 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:27.166330 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:27.166812 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:27.167322 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:27.167979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:27.168455 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:27.168875 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:27.353377 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-46d56abd-ee7d-4bca-a114-86da4ec506d5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:27.355061 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-46d56abd-ee7d-4bca-a114-86da4ec506d5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:27.362057 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46d56abd-ee7d-4bca-a114-86da4ec506d5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:27.362809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46d56abd-ee7d-4bca-a114-86da4ec506d5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:27.363290 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46d56abd-ee7d-4bca-a114-86da4ec506d5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:27.364264 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46d56abd-ee7d-4bca-a114-86da4ec506d5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:27.364726 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46d56abd-ee7d-4bca-a114-86da4ec506d5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:27.365322 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-46d56abd-ee7d-4bca-a114-86da4ec506d5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:27.383782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:27.393216 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:27.394716 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:27.396010 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b9d875d3-576d-40e2-8126-9b90166b4ce6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.241669 Aug 29 19:11:27.396584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 302/601] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:27 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:27.527602 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-46d56abd-ee7d-4bca-a114-86da4ec506d5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:27.536991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-46d56abd-ee7d-4bca-a114-86da4ec506d5 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.188806 Aug 29 19:11:27.537748 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 300/602] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:27 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:28.419411 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:28.420022 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:28.426750 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:28.427272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:28.427713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:28.428405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:28.428893 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:28.429320 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:28.558096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c3ff95fb-bc32-4794-93f9-b3dbe50eff86 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:28.558699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c3ff95fb-bc32-4794-93f9-b3dbe50eff86 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:28.566248 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3ff95fb-bc32-4794-93f9-b3dbe50eff86 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:28.566730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3ff95fb-bc32-4794-93f9-b3dbe50eff86 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:28.567240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3ff95fb-bc32-4794-93f9-b3dbe50eff86 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:28.567939 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3ff95fb-bc32-4794-93f9-b3dbe50eff86 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:28.568388 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3ff95fb-bc32-4794-93f9-b3dbe50eff86 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:28.569046 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3ff95fb-bc32-4794-93f9-b3dbe50eff86 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:28.652759 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:28.664371 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:28.666449 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:28.667535 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-05e72171-6367-41bf-99ea-f2894d04c6ed tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.252239 Aug 29 19:11:28.668105 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 303/603] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:28 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:28.736295 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c3ff95fb-bc32-4794-93f9-b3dbe50eff86 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:28.744082 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c3ff95fb-bc32-4794-93f9-b3dbe50eff86 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.190101 Aug 29 19:11:28.744660 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 301/604] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:28 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:29.694052 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:29.694661 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:29.701134 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:29.701646 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:29.702086 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:29.702780 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:29.703868 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:29.704302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:29.766969 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-aac5815d-927f-4163-869e-fb6d8cdba549 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:29.767752 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-aac5815d-927f-4163-869e-fb6d8cdba549 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:29.775030 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aac5815d-927f-4163-869e-fb6d8cdba549 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:29.775597 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aac5815d-927f-4163-869e-fb6d8cdba549 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:29.776059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aac5815d-927f-4163-869e-fb6d8cdba549 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:29.776788 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aac5815d-927f-4163-869e-fb6d8cdba549 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:29.777268 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aac5815d-927f-4163-869e-fb6d8cdba549 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:29.777734 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aac5815d-927f-4163-869e-fb6d8cdba549 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:29.864275 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:29.873023 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:29.874475 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:29.876603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6710c075-2442-47d0-ad6c-2e07d49e3e02 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.186204 Aug 29 19:11:29.879404 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 304/605] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:29 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:29.929091 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-aac5815d-927f-4163-869e-fb6d8cdba549 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:29.936694 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-aac5815d-927f-4163-869e-fb6d8cdba549 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.174758 Aug 29 19:11:29.937287 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 302/606] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:29 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:30.899359 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:30.899960 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:30.907083 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:30.907876 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:30.908315 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:30.909010 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:30.909461 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:30.909880 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:30.958140 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-78adc8eb-52dd-4f70-90c9-11b03fc7071c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:30.958749 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-78adc8eb-52dd-4f70-90c9-11b03fc7071c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:30.965194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78adc8eb-52dd-4f70-90c9-11b03fc7071c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:30.965676 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78adc8eb-52dd-4f70-90c9-11b03fc7071c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:30.966105 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78adc8eb-52dd-4f70-90c9-11b03fc7071c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:30.966793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78adc8eb-52dd-4f70-90c9-11b03fc7071c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:30.967268 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78adc8eb-52dd-4f70-90c9-11b03fc7071c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:30.967691 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78adc8eb-52dd-4f70-90c9-11b03fc7071c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:31.103855 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:31.113472 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:31.114963 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:31.116157 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f455fb2e-2f03-46a3-8260-e77dbf7ca905 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.220692 Aug 29 19:11:31.116720 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 305/607] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:30 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:31.133439 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-78adc8eb-52dd-4f70-90c9-11b03fc7071c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:31.141119 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-78adc8eb-52dd-4f70-90c9-11b03fc7071c tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.186967 Aug 29 19:11:31.141719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 303/608] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:30 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:32.140079 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:32.140615 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:32.147100 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:32.147592 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:32.148028 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:32.148716 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:32.149169 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:32.149623 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:32.162562 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-75430082-fdba-45fb-bf71-15afe09db43d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:32.163198 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-75430082-fdba-45fb-bf71-15afe09db43d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:32.169602 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75430082-fdba-45fb-bf71-15afe09db43d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:32.170080 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75430082-fdba-45fb-bf71-15afe09db43d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:32.170511 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75430082-fdba-45fb-bf71-15afe09db43d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:32.171222 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75430082-fdba-45fb-bf71-15afe09db43d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:32.171709 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75430082-fdba-45fb-bf71-15afe09db43d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:32.172128 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-75430082-fdba-45fb-bf71-15afe09db43d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:32.348162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:32.352391 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-75430082-fdba-45fb-bf71-15afe09db43d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:32.357957 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:32.359430 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:32.360242 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-75430082-fdba-45fb-bf71-15afe09db43d tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.201665 Aug 29 19:11:32.360702 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f43acc4f-a102-4d22-a47b-9a0daee267d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.224670 Aug 29 19:11:32.360963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 304/609] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:32 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:32.361504 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 306/610] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:32 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:11:32.640944 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-7c33bf54-ab25-4b4a-848b-5bff40a9f46e req-090eebf9-2e76-43b1-9804-e7f54fe23e42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4696f764-f3e7-482f-b94e-549896198ddf", "name": "network-vif-plugged", "status": "completed", "tag": "90bec49f-36b1-4027-8fc3-86cd4d15e3f4"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:32.651116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-7c33bf54-ab25-4b4a-848b-5bff40a9f46e req-090eebf9-2e76-43b1-9804-e7f54fe23e42 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:32.651608 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-7c33bf54-ab25-4b4a-848b-5bff40a9f46e req-090eebf9-2e76-43b1-9804-e7f54fe23e42 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:32.652037 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-7c33bf54-ab25-4b4a-848b-5bff40a9f46e req-090eebf9-2e76-43b1-9804-e7f54fe23e42 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:32.663612 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-7c33bf54-ab25-4b4a-848b-5bff40a9f46e req-090eebf9-2e76-43b1-9804-e7f54fe23e42 service nova] Creating event network-vif-plugged:90bec49f-36b1-4027-8fc3-86cd4d15e3f4 for instance 4696f764-f3e7-482f-b94e-549896198ddf on hv-cinder-73126 Aug 29 19:11:32.668429 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-7c33bf54-ab25-4b4a-848b-5bff40a9f46e req-090eebf9-2e76-43b1-9804-e7f54fe23e42 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031125 Aug 29 19:11:32.669028 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 305/611] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:33.380750 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-59f22ca3-aab9-499c-a3cb-2598eccb5889 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:33.381504 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-59f22ca3-aab9-499c-a3cb-2598eccb5889 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:33.386228 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:33.387836 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-59f22ca3-aab9-499c-a3cb-2598eccb5889 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:33.388181 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:33.388465 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-59f22ca3-aab9-499c-a3cb-2598eccb5889 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:33.389020 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-59f22ca3-aab9-499c-a3cb-2598eccb5889 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:33.389887 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-59f22ca3-aab9-499c-a3cb-2598eccb5889 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:33.390528 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-59f22ca3-aab9-499c-a3cb-2598eccb5889 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:33.390965 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-59f22ca3-aab9-499c-a3cb-2598eccb5889 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:33.395399 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:33.396166 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:33.396708 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:33.397705 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:33.398263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:33.398777 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:33.610994 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-59f22ca3-aab9-499c-a3cb-2598eccb5889 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:33.619822 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-59f22ca3-aab9-499c-a3cb-2598eccb5889 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.243052 Aug 29 19:11:33.620626 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 307/612] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:33 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:33.622735 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:33.633179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:33.634692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:33.635901 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-23928e65-2571-406a-bd3e-ebe0e523946e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.254880 Aug 29 19:11:33.636462 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 306/613] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:33 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:34.642158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-30cced3b-c954-4c10-aadb-cca5925f865f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:34.643046 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-30cced3b-c954-4c10-aadb-cca5925f865f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:34.649259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30cced3b-c954-4c10-aadb-cca5925f865f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:34.649750 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30cced3b-c954-4c10-aadb-cca5925f865f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:34.650209 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30cced3b-c954-4c10-aadb-cca5925f865f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:34.650877 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30cced3b-c954-4c10-aadb-cca5925f865f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:34.651358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30cced3b-c954-4c10-aadb-cca5925f865f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:34.651782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30cced3b-c954-4c10-aadb-cca5925f865f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:34.660635 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:34.661199 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:34.665069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=69 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:34.669025 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:34.669504 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:34.670007 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:34.670919 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:34.671403 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:34.671823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:34.865732 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-30cced3b-c954-4c10-aadb-cca5925f865f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:34.873501 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-30cced3b-c954-4c10-aadb-cca5925f865f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.235834 Aug 29 19:11:34.873703 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:34.874077 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 308/614] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:34 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:34.883704 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:34.885130 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:34.886274 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ac76a40c-04c4-4a15-bc71-8fceacfa6ccd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.230286 Aug 29 19:11:34.886828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 307/615] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:34 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:35.894883 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-289f3797-1859-4180-b1ed-613c121b7884 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:35.895519 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-289f3797-1859-4180-b1ed-613c121b7884 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:35.901491 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-289f3797-1859-4180-b1ed-613c121b7884 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:35.901978 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-289f3797-1859-4180-b1ed-613c121b7884 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:35.902412 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-289f3797-1859-4180-b1ed-613c121b7884 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:35.903130 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-289f3797-1859-4180-b1ed-613c121b7884 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:35.903587 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-289f3797-1859-4180-b1ed-613c121b7884 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:35.904012 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-289f3797-1859-4180-b1ed-613c121b7884 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:35.909707 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:35.910418 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:35.917069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:35.917546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:35.917973 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:35.918654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:35.919122 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:35.919542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:35.924509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:36.108223 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-289f3797-1859-4180-b1ed-613c121b7884 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:36.115541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:36.117976 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-289f3797-1859-4180-b1ed-613c121b7884 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.226954 Aug 29 19:11:36.119057 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 309/616] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:35 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:36.126409 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:36.127978 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:36.129136 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c59a782c-fd09-4d01-acc6-9f9c571efdfc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1807 microversion: 2.20 time: 0.223565 Aug 29 19:11:36.129693 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 308/617] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:35 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:36.943129 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-c7dfdb14-be1b-4480-a04b-3b27a670edda req-4195f7d0-3631-46bc-95a2-86747d1506cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693efce1-e294-4292-9e4c-289b5a18e7e7", "name": "network-vif-plugged", "status": "completed", "tag": "97d1e245-1b7b-4037-8040-3f51dfe1009e"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:36.952727 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-c7dfdb14-be1b-4480-a04b-3b27a670edda req-4195f7d0-3631-46bc-95a2-86747d1506cf service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:36.953185 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-c7dfdb14-be1b-4480-a04b-3b27a670edda req-4195f7d0-3631-46bc-95a2-86747d1506cf service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:36.953731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-c7dfdb14-be1b-4480-a04b-3b27a670edda req-4195f7d0-3631-46bc-95a2-86747d1506cf service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:36.966729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-c7dfdb14-be1b-4480-a04b-3b27a670edda req-4195f7d0-3631-46bc-95a2-86747d1506cf service nova] Creating event network-vif-plugged:97d1e245-1b7b-4037-8040-3f51dfe1009e for instance 693efce1-e294-4292-9e4c-289b5a18e7e7 on hv-cinder-73126 Aug 29 19:11:36.972971 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-c7dfdb14-be1b-4480-a04b-3b27a670edda req-4195f7d0-3631-46bc-95a2-86747d1506cf service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033520 Aug 29 19:11:36.973574 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 310/618] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:37.140951 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-266da8b0-be3b-45f7-9fef-3136cea7a996 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:37.142297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-266da8b0-be3b-45f7-9fef-3136cea7a996 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:37.149340 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-266da8b0-be3b-45f7-9fef-3136cea7a996 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:37.149826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-266da8b0-be3b-45f7-9fef-3136cea7a996 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:37.150256 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-266da8b0-be3b-45f7-9fef-3136cea7a996 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:37.150942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-266da8b0-be3b-45f7-9fef-3136cea7a996 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:37.151420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-266da8b0-be3b-45f7-9fef-3136cea7a996 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:37.151838 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-266da8b0-be3b-45f7-9fef-3136cea7a996 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:37.152602 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:37.153469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:37.160897 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:37.161398 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:37.161839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:37.162815 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:37.163452 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:37.163885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:37.426863 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:37.429472 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-266da8b0-be3b-45f7-9fef-3136cea7a996 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:37.435922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:37.437243 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-266da8b0-be3b-45f7-9fef-3136cea7a996 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.300122 Aug 29 19:11:37.437577 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:37.437812 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 309/619] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:37 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:37.439489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1d09f114-2e51-4701-8d8c-70df40a104c7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1794 microversion: 2.20 time: 0.291147 Aug 29 19:11:37.440049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 311/620] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:11:37 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1794 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:11:37.905591 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a1d0c138-d840-4acb-9ec3-248703b72213 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:37.906082 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a1d0c138-d840-4acb-9ec3-248703b72213 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:37.914065 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1d0c138-d840-4acb-9ec3-248703b72213 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:37.914541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1d0c138-d840-4acb-9ec3-248703b72213 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:37.914969 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1d0c138-d840-4acb-9ec3-248703b72213 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:37.915963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1d0c138-d840-4acb-9ec3-248703b72213 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:37.916212 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1d0c138-d840-4acb-9ec3-248703b72213 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:37.916632 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a1d0c138-d840-4acb-9ec3-248703b72213 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:38.000960 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-a1d0c138-d840-4acb-9ec3-248703b72213 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lazy-loading 'services' on Instance uuid 22f96567-e842-4352-9e40-e31d2f547937 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:11:38.078447 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a1d0c138-d840-4acb-9ec3-248703b72213 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "DELETE /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/os-volume_attachments/0e08e44c-474a-4b6a-9dfc-773f59a827ea" status: 202 len: 0 microversion: 2.1 time: 0.176771 Aug 29 19:11:38.079586 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 310/621] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:11:37 2022] DELETE /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/os-volume_attachments/0e08e44c-474a-4b6a-9dfc-773f59a827ea => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:11:38.460821 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c8db5369-8657-43bb-b515-22913be28c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:38.461382 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c8db5369-8657-43bb-b515-22913be28c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:38.467295 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8db5369-8657-43bb-b515-22913be28c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:38.467777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8db5369-8657-43bb-b515-22913be28c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:38.468212 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8db5369-8657-43bb-b515-22913be28c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:38.468929 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8db5369-8657-43bb-b515-22913be28c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:38.469784 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8db5369-8657-43bb-b515-22913be28c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:38.470404 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8db5369-8657-43bb-b515-22913be28c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:38.602806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c8db5369-8657-43bb-b515-22913be28c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:38.610654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c8db5369-8657-43bb-b515-22913be28c25 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.153497 Aug 29 19:11:38.611248 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 312/622] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:38 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:39.634897 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-261b2c97-fa1a-4d15-a079-888f1a0f5297 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:39.635642 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-261b2c97-fa1a-4d15-a079-888f1a0f5297 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:39.641874 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-261b2c97-fa1a-4d15-a079-888f1a0f5297 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:39.642357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-261b2c97-fa1a-4d15-a079-888f1a0f5297 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:39.642785 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-261b2c97-fa1a-4d15-a079-888f1a0f5297 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:39.643495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-261b2c97-fa1a-4d15-a079-888f1a0f5297 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:39.643949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-261b2c97-fa1a-4d15-a079-888f1a0f5297 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:39.644366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-261b2c97-fa1a-4d15-a079-888f1a0f5297 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:39.775273 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-261b2c97-fa1a-4d15-a079-888f1a0f5297 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:39.783329 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-261b2c97-fa1a-4d15-a079-888f1a0f5297 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.153206 Aug 29 19:11:39.783908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 311/623] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:39 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:40.254263 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b2f4279d-c393-4d54-91ca-0131bacb9341 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:40.260370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b2f4279d-c393-4d54-91ca-0131bacb9341 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:40.260853 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b2f4279d-c393-4d54-91ca-0131bacb9341 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:40.261287 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b2f4279d-c393-4d54-91ca-0131bacb9341 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:40.316419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=100 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:40.323313 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b2f4279d-c393-4d54-91ca-0131bacb9341 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Going to try to stop instance {{(pid=115967) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 19:11:40.366471 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b2f4279d-c393-4d54-91ca-0131bacb9341 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "POST /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/action" status: 202 len: 0 microversion: 2.1 time: 0.116126 Aug 29 19:11:40.367252 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 313/624] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:11:40 2022] POST /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:11:40.375688 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ebb8fa8b-11ba-4a5b-b3ae-956e56ff0b3d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:40.376545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ebb8fa8b-11ba-4a5b-b3ae-956e56ff0b3d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:40.382997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ebb8fa8b-11ba-4a5b-b3ae-956e56ff0b3d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:40.383549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ebb8fa8b-11ba-4a5b-b3ae-956e56ff0b3d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:40.384013 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ebb8fa8b-11ba-4a5b-b3ae-956e56ff0b3d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:40.384714 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ebb8fa8b-11ba-4a5b-b3ae-956e56ff0b3d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:40.385178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ebb8fa8b-11ba-4a5b-b3ae-956e56ff0b3d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:40.385606 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ebb8fa8b-11ba-4a5b-b3ae-956e56ff0b3d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:40.520183 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ebb8fa8b-11ba-4a5b-b3ae-956e56ff0b3d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:40.527846 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ebb8fa8b-11ba-4a5b-b3ae-956e56ff0b3d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.156343 Aug 29 19:11:40.528429 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 312/625] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:40 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:40.804951 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6c9827ee-a257-4d73-9a64-082440dc86c8 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:40.805641 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6c9827ee-a257-4d73-9a64-082440dc86c8 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:40.811723 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c9827ee-a257-4d73-9a64-082440dc86c8 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:40.812235 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c9827ee-a257-4d73-9a64-082440dc86c8 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:40.812667 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c9827ee-a257-4d73-9a64-082440dc86c8 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:40.813912 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c9827ee-a257-4d73-9a64-082440dc86c8 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:40.814362 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c9827ee-a257-4d73-9a64-082440dc86c8 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:40.814787 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c9827ee-a257-4d73-9a64-082440dc86c8 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:40.944562 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6c9827ee-a257-4d73-9a64-082440dc86c8 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:40.952836 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6c9827ee-a257-4d73-9a64-082440dc86c8 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1319 microversion: 2.1 time: 0.152129 Aug 29 19:11:40.953400 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 314/626] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:40 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:41.550560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fee3794c-f2e2-4273-98e1-564658905947 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:41.551218 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fee3794c-f2e2-4273-98e1-564658905947 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:41.557762 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fee3794c-f2e2-4273-98e1-564658905947 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:41.558238 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fee3794c-f2e2-4273-98e1-564658905947 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:41.558664 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fee3794c-f2e2-4273-98e1-564658905947 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:41.559372 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fee3794c-f2e2-4273-98e1-564658905947 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:41.559820 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fee3794c-f2e2-4273-98e1-564658905947 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:41.560266 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fee3794c-f2e2-4273-98e1-564658905947 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:41.694601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fee3794c-f2e2-4273-98e1-564658905947 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:41.702337 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fee3794c-f2e2-4273-98e1-564658905947 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.156436 Aug 29 19:11:41.702916 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 313/627] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:41 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:41.974501 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b124d2c7-25c4-4e20-a67e-24704e0d2408 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:41.975050 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b124d2c7-25c4-4e20-a67e-24704e0d2408 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:41.981112 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b124d2c7-25c4-4e20-a67e-24704e0d2408 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:41.981625 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b124d2c7-25c4-4e20-a67e-24704e0d2408 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:41.982076 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b124d2c7-25c4-4e20-a67e-24704e0d2408 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:41.982759 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b124d2c7-25c4-4e20-a67e-24704e0d2408 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:41.983249 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b124d2c7-25c4-4e20-a67e-24704e0d2408 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:41.983707 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b124d2c7-25c4-4e20-a67e-24704e0d2408 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.117312 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b124d2c7-25c4-4e20-a67e-24704e0d2408 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:42.125012 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b124d2c7-25c4-4e20-a67e-24704e0d2408 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1508 microversion: 2.1 time: 0.155171 Aug 29 19:11:42.125573 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 315/628] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:41 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:42.147149 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0cb6dba5-cabc-4557-a21e-bd36aacf4c7f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd971d99-fd20-4a7f-a216-e5041c805c69", "device": "/dev/sdb"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:42.149656 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0cb6dba5-cabc-4557-a21e-bd36aacf4c7f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:42.155545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cb6dba5-cabc-4557-a21e-bd36aacf4c7f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.156027 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cb6dba5-cabc-4557-a21e-bd36aacf4c7f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.156461 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cb6dba5-cabc-4557-a21e-bd36aacf4c7f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.157810 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cb6dba5-cabc-4557-a21e-bd36aacf4c7f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.158826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cb6dba5-cabc-4557-a21e-bd36aacf4c7f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.159282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cb6dba5-cabc-4557-a21e-bd36aacf4c7f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.534989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-77cc40aa-7759-4adf-92ce-3468c434dde4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:42.535441 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-77cc40aa-7759-4adf-92ce-3468c434dde4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:42.541873 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77cc40aa-7759-4adf-92ce-3468c434dde4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.542357 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77cc40aa-7759-4adf-92ce-3468c434dde4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.542806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77cc40aa-7759-4adf-92ce-3468c434dde4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.543519 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77cc40aa-7759-4adf-92ce-3468c434dde4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.543967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77cc40aa-7759-4adf-92ce-3468c434dde4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.544392 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77cc40aa-7759-4adf-92ce-3468c434dde4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.567909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-77cc40aa-7759-4adf-92ce-3468c434dde4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0/ips" status: 200 len: 150 microversion: 2.1 time: 0.037588 Aug 29 19:11:42.568804 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 316/629] 10.222.0.94 () {58 vars in 1248 bytes} [Mon Aug 29 19:11:42 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:11:42.580595 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4572b37-e415-4786-b0cc-e8bb98a3c83e"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:42.583057 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:42.589141 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.589616 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.590042 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.590723 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.591200 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.591617 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.676108 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Invalid volume: volume f4572b37-e415-4786-b0cc-e8bb98a3c83e is already attached to instances: 3f54a0ab-56bd-45b7-9026-0c998c315879 Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: POST /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0/os-volume_attachments HTTP/1.1 Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 74 Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:11:42.677949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {"volumeAttachment": {"volumeId": "f4572b37-e415-4786-b0cc-e8bb98a3c83e"}} Aug 29 19:11:42.679307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Invalid volume: volume f4572b37-e415-4786-b0cc-e8bb98a3c83e is already attached to instances: 3f54a0ab-56bd-45b7-9026-0c998c315879 Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'server_id': '43a8cf0d-0651-4bf9-9fc2-24a66d1528a0', 'body': {'volumeAttachment': {'volumeId': 'f4572b37-e415-4786-b0cc-e8bb98a3c83e'}}} Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f4572b37-e415-4786-b0cc-e8bb98a3c83e is already attached to instances: 3f54a0ab-56bd-45b7-9026-0c998c315879 Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:11:42.680296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f4572b37-e415-4786-b0cc-e8bb98a3c83e is already attached to instances: 3f54a0ab-56bd-45b7-9026-0c998c315879 Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:42.681432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:11:42.682676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:11:42.682676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:11:42.682676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:11:42.682676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f4572b37-e415-4786-b0cc-e8bb98a3c83e is already attached to instances: 3f54a0ab-56bd-45b7-9026-0c998c315879 Aug 29 19:11:42.682676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:11:42.682676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 400 to user: Invalid volume: volume f4572b37-e415-4786-b0cc-e8bb98a3c83e is already attached to instances: 3f54a0ab-56bd-45b7-9026-0c998c315879 {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:11:42.682676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b1856737-999a-421b-ad04-d782160f38a8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103625 Aug 29 19:11:42.682676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 317/630] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:11:42 2022] POST /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 19:11:42.688922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-4ccc2ac3-98fe-4348-8e29-ff23cdaac0da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:42.691331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-4ccc2ac3-98fe-4348-8e29-ff23cdaac0da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:42.697570 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4ccc2ac3-98fe-4348-8e29-ff23cdaac0da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.698056 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4ccc2ac3-98fe-4348-8e29-ff23cdaac0da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.698486 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4ccc2ac3-98fe-4348-8e29-ff23cdaac0da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.699202 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4ccc2ac3-98fe-4348-8e29-ff23cdaac0da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.699654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4ccc2ac3-98fe-4348-8e29-ff23cdaac0da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.700071 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4ccc2ac3-98fe-4348-8e29-ff23cdaac0da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.727110 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-4ccc2ac3-98fe-4348-8e29-ff23cdaac0da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:11:42.772513 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0cb6dba5-cabc-4557-a21e-bd36aacf4c7f tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "POST /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629188 Aug 29 19:11:42.773504 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 314/631] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:11:42 2022] POST /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:11:42.779285 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-739c74b0-e09c-423d-be44-5de78e3db25b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:42.779977 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-739c74b0-e09c-423d-be44-5de78e3db25b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:42.788252 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-739c74b0-e09c-423d-be44-5de78e3db25b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.788787 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-739c74b0-e09c-423d-be44-5de78e3db25b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.789378 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-739c74b0-e09c-423d-be44-5de78e3db25b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.790341 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-739c74b0-e09c-423d-be44-5de78e3db25b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.791092 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-739c74b0-e09c-423d-be44-5de78e3db25b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.791703 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-739c74b0-e09c-423d-be44-5de78e3db25b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.816269 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-4ccc2ac3-98fe-4348-8e29-ff23cdaac0da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 204 len: 0 microversion: 2.1 time: 0.131232 Aug 29 19:11:42.817190 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 318/632] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:11:42 2022] DELETE /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:11:42.832533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bb7adee2-07bd-4b2e-9534-2b55c5eb2526 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:42.835091 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bb7adee2-07bd-4b2e-9534-2b55c5eb2526 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:42.843120 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb7adee2-07bd-4b2e-9534-2b55c5eb2526 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.843120 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb7adee2-07bd-4b2e-9534-2b55c5eb2526 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.843120 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb7adee2-07bd-4b2e-9534-2b55c5eb2526 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:42.843540 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb7adee2-07bd-4b2e-9534-2b55c5eb2526 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:42.843989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb7adee2-07bd-4b2e-9534-2b55c5eb2526 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:42.845319 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bb7adee2-07bd-4b2e-9534-2b55c5eb2526 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:43.002009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-739c74b0-e09c-423d-be44-5de78e3db25b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:43.010124 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-739c74b0-e09c-423d-be44-5de78e3db25b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.235340 Aug 29 19:11:43.010989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 315/633] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:42 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:43.026420 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-bb7adee2-07bd-4b2e-9534-2b55c5eb2526 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:43.034090 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bb7adee2-07bd-4b2e-9534-2b55c5eb2526 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1682 microversion: 2.1 time: 0.211967 Aug 29 19:11:43.034656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 319/634] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:42 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:44.033261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1e231ca9-52a7-40f2-b454-72e8e9f1f3c2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:44.033862 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1e231ca9-52a7-40f2-b454-72e8e9f1f3c2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:44.040446 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1e231ca9-52a7-40f2-b454-72e8e9f1f3c2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:44.040923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1e231ca9-52a7-40f2-b454-72e8e9f1f3c2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:44.041355 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1e231ca9-52a7-40f2-b454-72e8e9f1f3c2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:44.042033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1e231ca9-52a7-40f2-b454-72e8e9f1f3c2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:44.042480 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1e231ca9-52a7-40f2-b454-72e8e9f1f3c2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:44.042902 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1e231ca9-52a7-40f2-b454-72e8e9f1f3c2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:44.055260 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e3582538-07cf-4b8f-afeb-e2ae8a0c2a8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:44.055874 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e3582538-07cf-4b8f-afeb-e2ae8a0c2a8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:44.061706 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3582538-07cf-4b8f-afeb-e2ae8a0c2a8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:44.062192 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3582538-07cf-4b8f-afeb-e2ae8a0c2a8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:44.062622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3582538-07cf-4b8f-afeb-e2ae8a0c2a8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:44.063419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3582538-07cf-4b8f-afeb-e2ae8a0c2a8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:44.063882 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3582538-07cf-4b8f-afeb-e2ae8a0c2a8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:44.064310 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e3582538-07cf-4b8f-afeb-e2ae8a0c2a8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:44.241520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1e231ca9-52a7-40f2-b454-72e8e9f1f3c2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:44.245514 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e3582538-07cf-4b8f-afeb-e2ae8a0c2a8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:44.249591 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1e231ca9-52a7-40f2-b454-72e8e9f1f3c2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.221071 Aug 29 19:11:44.250240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 316/635] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:44 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:44.253445 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e3582538-07cf-4b8f-afeb-e2ae8a0c2a8a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1682 microversion: 2.1 time: 0.201993 Aug 29 19:11:44.253941 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 320/636] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:44 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1682 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:45.271539 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-27ae8511-bd27-431e-a2b6-4924521863f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:45.272148 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-27ae8511-bd27-431e-a2b6-4924521863f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:45.275013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3d4ba190-8bda-484a-949f-4e95c587cbca tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:45.275791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3d4ba190-8bda-484a-949f-4e95c587cbca tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:45.278699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27ae8511-bd27-431e-a2b6-4924521863f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:45.279214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27ae8511-bd27-431e-a2b6-4924521863f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:45.279647 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27ae8511-bd27-431e-a2b6-4924521863f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:45.280342 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27ae8511-bd27-431e-a2b6-4924521863f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:45.280797 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27ae8511-bd27-431e-a2b6-4924521863f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:45.281215 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-27ae8511-bd27-431e-a2b6-4924521863f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:45.281568 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d4ba190-8bda-484a-949f-4e95c587cbca tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:45.282769 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d4ba190-8bda-484a-949f-4e95c587cbca tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:45.283330 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d4ba190-8bda-484a-949f-4e95c587cbca tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:45.283726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d4ba190-8bda-484a-949f-4e95c587cbca tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:45.284185 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d4ba190-8bda-484a-949f-4e95c587cbca tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:45.284612 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d4ba190-8bda-484a-949f-4e95c587cbca tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:45.589183 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-27ae8511-bd27-431e-a2b6-4924521863f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:45.597729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-27ae8511-bd27-431e-a2b6-4924521863f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.330171 Aug 29 19:11:45.598243 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3d4ba190-8bda-484a-949f-4e95c587cbca tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:45.598412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 317/637] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:45 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:45.607029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3d4ba190-8bda-484a-949f-4e95c587cbca tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1682 microversion: 2.1 time: 0.336023 Aug 29 19:11:45.607938 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 321/638] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:45 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1682 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:46.601224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-3717a644-969d-4f64-9d58-5c78cead2b41 req-bee8a68b-3365-4a5c-83f9-8c376891f337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43a8cf0d-0651-4bf9-9fc2-24a66d1528a0", "name": "network-vif-deleted", "tag": "7d4b5dab-5d4d-4df3-a064-13f32c7a8555"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:46.612612 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-3717a644-969d-4f64-9d58-5c78cead2b41 req-bee8a68b-3365-4a5c-83f9-8c376891f337 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:46.613095 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-3717a644-969d-4f64-9d58-5c78cead2b41 req-bee8a68b-3365-4a5c-83f9-8c376891f337 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:46.613526 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-3717a644-969d-4f64-9d58-5c78cead2b41 req-bee8a68b-3365-4a5c-83f9-8c376891f337 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:46.622096 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0516ff99-58ab-4ab0-ad1d-47280f009cca tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:46.625258 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0516ff99-58ab-4ab0-ad1d-47280f009cca tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:46.632867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-3717a644-969d-4f64-9d58-5c78cead2b41 req-bee8a68b-3365-4a5c-83f9-8c376891f337 service nova] Creating event network-vif-deleted:7d4b5dab-5d4d-4df3-a064-13f32c7a8555 for instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 on hv-cinder-73126 Aug 29 19:11:46.633248 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0516ff99-58ab-4ab0-ad1d-47280f009cca tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:46.633791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0516ff99-58ab-4ab0-ad1d-47280f009cca tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:46.634250 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0516ff99-58ab-4ab0-ad1d-47280f009cca tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:46.634956 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0516ff99-58ab-4ab0-ad1d-47280f009cca tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:46.635448 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0516ff99-58ab-4ab0-ad1d-47280f009cca tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:46.635877 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0516ff99-58ab-4ab0-ad1d-47280f009cca tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:46.647269 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-3717a644-969d-4f64-9d58-5c78cead2b41 req-bee8a68b-3365-4a5c-83f9-8c376891f337 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049550 Aug 29 19:11:46.652306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 318/639] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:46.660171 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-4d25b197-653f-4732-abba-1524c25140b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:46.661510 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-4d25b197-653f-4732-abba-1524c25140b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:46.669116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d25b197-653f-4732-abba-1524c25140b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:46.670355 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d25b197-653f-4732-abba-1524c25140b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:46.670914 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d25b197-653f-4732-abba-1524c25140b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:46.671943 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d25b197-653f-4732-abba-1524c25140b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:46.672495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d25b197-653f-4732-abba-1524c25140b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:46.673888 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4d25b197-653f-4732-abba-1524c25140b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:46.772336 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4d25b197-653f-4732-abba-1524c25140b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:46.781659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-4d25b197-653f-4732-abba-1524c25140b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1327 microversion: 2.1 time: 0.127027 Aug 29 19:11:46.796195 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 319/640] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:46 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1327 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:46.834987 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0516ff99-58ab-4ab0-ad1d-47280f009cca tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:46.843114 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0516ff99-58ab-4ab0-ad1d-47280f009cca tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.225131 Aug 29 19:11:46.843695 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 322/641] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:46 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:47.805321 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:47.805990 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:47.813077 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:47.814439 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:47.815115 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:47.816019 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:47.816531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:47.817144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:47.858374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:47.858962 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:47.859477 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:47.860028 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lazy-loading 'fault' on Instance uuid 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:11:47.865796 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a7f472ab-2eb9-4c9e-9903-5788351dd4af tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:47.866401 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a7f472ab-2eb9-4c9e-9903-5788351dd4af tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:47.874064 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a7f472ab-2eb9-4c9e-9903-5788351dd4af tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:47.875025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a7f472ab-2eb9-4c9e-9903-5788351dd4af tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:47.875437 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a7f472ab-2eb9-4c9e-9903-5788351dd4af tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:47.877220 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a7f472ab-2eb9-4c9e-9903-5788351dd4af tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:47.877744 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a7f472ab-2eb9-4c9e-9903-5788351dd4af tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:47.878173 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a7f472ab-2eb9-4c9e-9903-5788351dd4af tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:47.904072 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:47.915363 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1c228536-23b2-4b47-a770-cae047185a02 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 200 len: 1332 microversion: 2.1 time: 0.113963 Aug 29 19:11:47.916216 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 320/642] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:47 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:48.019727 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a7f472ab-2eb9-4c9e-9903-5788351dd4af tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:48.027788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a7f472ab-2eb9-4c9e-9903-5788351dd4af tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.165925 Aug 29 19:11:48.028378 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 323/643] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:47 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:48.936419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:48.936946 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:48.943528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:48.944008 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:48.944438 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:48.945114 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:48.945619 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:48.946036 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:48.959025 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 HTTP/1.1 Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:11:48.960659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:11:48.962139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '43a8cf0d-0651-4bf9-9fc2-24a66d1528a0'} Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:11:48.963006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:11:48.964437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:11:48.965724 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:11:48.965724 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0cf3079b-8f0b-42ff-a910-aa5845bc069c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 404 len: 111 microversion: 2.1 time: 0.029722 Aug 29 19:11:48.965724 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 321/644] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:48 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:11:48.971685 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-54f4d93b-2067-42b4-a930-ec79d8fd7368 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '.version_select at 0x7f3d764320d0>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:48.991973 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-54f4d93b-2067-42b4-a930-ec79d8fd7368 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470411950" status: 202 len: 0 microversion: 2.1 time: 0.024866 Aug 29 19:11:48.992531 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 324/645] 10.222.0.94 () {58 vars in 1221 bytes} [Mon Aug 29 19:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470411950 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:11:49.050514 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b930972d-3454-4304-a392-a0436949a33c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:49.051152 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b930972d-3454-4304-a392-a0436949a33c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:49.057174 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b930972d-3454-4304-a392-a0436949a33c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:49.057658 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b930972d-3454-4304-a392-a0436949a33c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:49.058090 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b930972d-3454-4304-a392-a0436949a33c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:49.058782 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b930972d-3454-4304-a392-a0436949a33c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:49.059270 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b930972d-3454-4304-a392-a0436949a33c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:49.059691 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b930972d-3454-4304-a392-a0436949a33c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:49.295498 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b930972d-3454-4304-a392-a0436949a33c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:49.303243 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b930972d-3454-4304-a392-a0436949a33c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.257401 Aug 29 19:11:49.303808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 322/646] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:49 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:49.673029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-78289dc1-c2f2-47b5-a696-63498308625e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:49.673532 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-78289dc1-c2f2-47b5-a696-63498308625e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:49.679547 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78289dc1-c2f2-47b5-a696-63498308625e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:49.680029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78289dc1-c2f2-47b5-a696-63498308625e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:49.680468 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78289dc1-c2f2-47b5-a696-63498308625e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:49.681154 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78289dc1-c2f2-47b5-a696-63498308625e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:49.681658 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78289dc1-c2f2-47b5-a696-63498308625e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:49.682321 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78289dc1-c2f2-47b5-a696-63498308625e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:49.961117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-78289dc1-c2f2-47b5-a696-63498308625e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lazy-loading 'services' on Instance uuid 3f54a0ab-56bd-45b7-9026-0c998c315879 {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:11:50.079725 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-78289dc1-c2f2-47b5-a696-63498308625e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments/f4572b37-e415-4786-b0cc-e8bb98a3c83e" status: 202 len: 0 microversion: 2.1 time: 0.410445 Aug 29 19:11:50.080539 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 325/647] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:11:49 2022] DELETE /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments/f4572b37-e415-4786-b0cc-e8bb98a3c83e => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:11:50.088813 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-da89a65f-c5bd-462b-bdc4-9ef528215a00 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:50.091747 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-da89a65f-c5bd-462b-bdc4-9ef528215a00 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:50.098407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-da89a65f-c5bd-462b-bdc4-9ef528215a00 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:50.098887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-da89a65f-c5bd-462b-bdc4-9ef528215a00 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:50.099534 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-da89a65f-c5bd-462b-bdc4-9ef528215a00 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:50.100242 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-da89a65f-c5bd-462b-bdc4-9ef528215a00 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:50.100699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-da89a65f-c5bd-462b-bdc4-9ef528215a00 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:50.101121 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-da89a65f-c5bd-462b-bdc4-9ef528215a00 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:50.127266 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:50.132693 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-da89a65f-c5bd-462b-bdc4-9ef528215a00 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047955 Aug 29 19:11:50.133279 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 323/648] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:11:50 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:50.325318 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d7ce2dc4-fd64-400c-97df-6b3248356a6c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:50.326021 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d7ce2dc4-fd64-400c-97df-6b3248356a6c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:50.332203 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d7ce2dc4-fd64-400c-97df-6b3248356a6c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:50.332691 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d7ce2dc4-fd64-400c-97df-6b3248356a6c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:50.333129 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d7ce2dc4-fd64-400c-97df-6b3248356a6c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:50.333815 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d7ce2dc4-fd64-400c-97df-6b3248356a6c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:50.334272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d7ce2dc4-fd64-400c-97df-6b3248356a6c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:50.334704 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d7ce2dc4-fd64-400c-97df-6b3248356a6c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:50.465970 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d7ce2dc4-fd64-400c-97df-6b3248356a6c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:50.474273 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d7ce2dc4-fd64-400c-97df-6b3248356a6c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.153180 Aug 29 19:11:50.474836 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 326/649] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:50 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:51.146846 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a893a7a3-fb6a-4a77-8cbc-c8f7ccb142c6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:51.149095 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a893a7a3-fb6a-4a77-8cbc-c8f7ccb142c6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:51.156706 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a893a7a3-fb6a-4a77-8cbc-c8f7ccb142c6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:51.157259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a893a7a3-fb6a-4a77-8cbc-c8f7ccb142c6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:51.157787 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a893a7a3-fb6a-4a77-8cbc-c8f7ccb142c6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:51.158480 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a893a7a3-fb6a-4a77-8cbc-c8f7ccb142c6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:51.159058 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a893a7a3-fb6a-4a77-8cbc-c8f7ccb142c6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:51.159391 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a893a7a3-fb6a-4a77-8cbc-c8f7ccb142c6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:51.189517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a893a7a3-fb6a-4a77-8cbc-c8f7ccb142c6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048228 Aug 29 19:11:51.190090 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 324/650] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:11:51 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:51.495911 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ea158154-e8d5-45b3-b659-fd6a42763e2d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:51.496656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ea158154-e8d5-45b3-b659-fd6a42763e2d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:51.503457 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea158154-e8d5-45b3-b659-fd6a42763e2d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:51.503944 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea158154-e8d5-45b3-b659-fd6a42763e2d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:51.504386 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea158154-e8d5-45b3-b659-fd6a42763e2d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:51.505082 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea158154-e8d5-45b3-b659-fd6a42763e2d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:51.505541 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea158154-e8d5-45b3-b659-fd6a42763e2d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:51.505990 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea158154-e8d5-45b3-b659-fd6a42763e2d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:51.640595 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ea158154-e8d5-45b3-b659-fd6a42763e2d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:51.648996 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ea158154-e8d5-45b3-b659-fd6a42763e2d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.156878 Aug 29 19:11:51.649583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 327/651] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:51 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:11:52.202535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-62b6e810-6e76-45e9-87a6-4649942c93db tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:52.204602 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-62b6e810-6e76-45e9-87a6-4649942c93db tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:52.211581 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62b6e810-6e76-45e9-87a6-4649942c93db tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:52.212060 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62b6e810-6e76-45e9-87a6-4649942c93db tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:52.212491 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62b6e810-6e76-45e9-87a6-4649942c93db tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:52.213175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62b6e810-6e76-45e9-87a6-4649942c93db tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:52.213626 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62b6e810-6e76-45e9-87a6-4649942c93db tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:52.214043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62b6e810-6e76-45e9-87a6-4649942c93db tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:52.247584 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-62b6e810-6e76-45e9-87a6-4649942c93db tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049080 Aug 29 19:11:52.248156 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 325/652] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:11:52 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:52.670240 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9985ea1a-ab10-4d81-9484-75afdcc42486 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:52.670842 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9985ea1a-ab10-4d81-9484-75afdcc42486 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:52.677246 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9985ea1a-ab10-4d81-9484-75afdcc42486 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:52.677732 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9985ea1a-ab10-4d81-9484-75afdcc42486 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:52.678166 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9985ea1a-ab10-4d81-9484-75afdcc42486 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:52.678852 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9985ea1a-ab10-4d81-9484-75afdcc42486 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:52.679365 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9985ea1a-ab10-4d81-9484-75afdcc42486 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:52.679890 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9985ea1a-ab10-4d81-9484-75afdcc42486 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:52.684077 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:52.810637 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9985ea1a-ab10-4d81-9484-75afdcc42486 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:52.818891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9985ea1a-ab10-4d81-9484-75afdcc42486 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.152492 Aug 29 19:11:52.819477 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 328/653] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:52 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:53.261625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c7b594c6-2078-4690-8e7d-d81f786d277d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:53.264441 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c7b594c6-2078-4690-8e7d-d81f786d277d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:53.273223 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7b594c6-2078-4690-8e7d-d81f786d277d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:53.273829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7b594c6-2078-4690-8e7d-d81f786d277d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:53.274276 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7b594c6-2078-4690-8e7d-d81f786d277d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:53.274983 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7b594c6-2078-4690-8e7d-d81f786d277d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:53.275472 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7b594c6-2078-4690-8e7d-d81f786d277d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:53.275898 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c7b594c6-2078-4690-8e7d-d81f786d277d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:53.309304 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c7b594c6-2078-4690-8e7d-d81f786d277d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051934 Aug 29 19:11:53.309888 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 326/654] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:11:53 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:11:53.840512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6fbde906-2d49-4949-b637-4cb76edd89ed tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:53.841152 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6fbde906-2d49-4949-b637-4cb76edd89ed tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:53.848010 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fbde906-2d49-4949-b637-4cb76edd89ed tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:53.848499 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fbde906-2d49-4949-b637-4cb76edd89ed tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:53.848935 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fbde906-2d49-4949-b637-4cb76edd89ed tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:53.849631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fbde906-2d49-4949-b637-4cb76edd89ed tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:53.850084 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fbde906-2d49-4949-b637-4cb76edd89ed tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:53.850509 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fbde906-2d49-4949-b637-4cb76edd89ed tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:53.977774 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6fbde906-2d49-4949-b637-4cb76edd89ed tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:53.985321 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6fbde906-2d49-4949-b637-4cb76edd89ed tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.148807 Aug 29 19:11:53.985891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 329/655] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:53 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:54.322741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a308a9ad-862c-4bca-bdf6-a473120ea713 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:54.324882 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a308a9ad-862c-4bca-bdf6-a473120ea713 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:54.331823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a308a9ad-862c-4bca-bdf6-a473120ea713 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:54.332312 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a308a9ad-862c-4bca-bdf6-a473120ea713 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:54.332742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a308a9ad-862c-4bca-bdf6-a473120ea713 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:54.333424 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a308a9ad-862c-4bca-bdf6-a473120ea713 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:54.333874 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a308a9ad-862c-4bca-bdf6-a473120ea713 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:54.334293 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a308a9ad-862c-4bca-bdf6-a473120ea713 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:54.362768 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a308a9ad-862c-4bca-bdf6-a473120ea713 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044311 Aug 29 19:11:54.363366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 327/656] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:11:54 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:11:54.426165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7ee3a3d5-8847-4105-a17a-b4b6b57775ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:54.426661 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7ee3a3d5-8847-4105-a17a-b4b6b57775ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:54.432556 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7ee3a3d5-8847-4105-a17a-b4b6b57775ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:54.433070 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7ee3a3d5-8847-4105-a17a-b4b6b57775ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:54.433514 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7ee3a3d5-8847-4105-a17a-b4b6b57775ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:54.434205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7ee3a3d5-8847-4105-a17a-b4b6b57775ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:54.434663 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7ee3a3d5-8847-4105-a17a-b4b6b57775ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:54.435106 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7ee3a3d5-8847-4105-a17a-b4b6b57775ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:54.461412 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7ee3a3d5-8847-4105-a17a-b4b6b57775ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:11:54.535579 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7ee3a3d5-8847-4105-a17a-b4b6b57775ae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 204 len: 0 microversion: 2.1 time: 0.112936 Aug 29 19:11:54.536161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 330/657] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:11:54 2022] DELETE /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:11:54.544442 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5bde67fa-ed35-4eac-9a38-5417c3b106e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:54.545139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5bde67fa-ed35-4eac-9a38-5417c3b106e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:54.551604 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bde67fa-ed35-4eac-9a38-5417c3b106e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:54.552087 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bde67fa-ed35-4eac-9a38-5417c3b106e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:54.552523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bde67fa-ed35-4eac-9a38-5417c3b106e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:54.553219 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bde67fa-ed35-4eac-9a38-5417c3b106e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:54.553674 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bde67fa-ed35-4eac-9a38-5417c3b106e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:54.554099 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bde67fa-ed35-4eac-9a38-5417c3b106e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:54.686709 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5bde67fa-ed35-4eac-9a38-5417c3b106e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:54.695288 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5bde67fa-ed35-4eac-9a38-5417c3b106e5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1684 microversion: 2.1 time: 0.154499 Aug 29 19:11:54.695860 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 328/658] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:54 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:55.007003 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cd429c2d-be00-46f2-95ee-1fd633fb0b38 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:55.007731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cd429c2d-be00-46f2-95ee-1fd633fb0b38 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:55.013658 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd429c2d-be00-46f2-95ee-1fd633fb0b38 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:55.014143 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd429c2d-be00-46f2-95ee-1fd633fb0b38 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:55.014584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd429c2d-be00-46f2-95ee-1fd633fb0b38 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:55.015297 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd429c2d-be00-46f2-95ee-1fd633fb0b38 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:55.015754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd429c2d-be00-46f2-95ee-1fd633fb0b38 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:55.016177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd429c2d-be00-46f2-95ee-1fd633fb0b38 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:55.146299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cd429c2d-be00-46f2-95ee-1fd633fb0b38 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:55.154002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cd429c2d-be00-46f2-95ee-1fd633fb0b38 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.151400 Aug 29 19:11:55.154565 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 331/659] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:55 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:55.716417 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6979dfd0-9822-465d-8d0b-98036a5918f7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:55.717136 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6979dfd0-9822-465d-8d0b-98036a5918f7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:55.724361 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6979dfd0-9822-465d-8d0b-98036a5918f7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:55.724845 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6979dfd0-9822-465d-8d0b-98036a5918f7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:55.725283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6979dfd0-9822-465d-8d0b-98036a5918f7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:55.725974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6979dfd0-9822-465d-8d0b-98036a5918f7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:55.726429 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6979dfd0-9822-465d-8d0b-98036a5918f7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:55.726856 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6979dfd0-9822-465d-8d0b-98036a5918f7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:55.859407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6979dfd0-9822-465d-8d0b-98036a5918f7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:55.867953 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6979dfd0-9822-465d-8d0b-98036a5918f7 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1684 microversion: 2.1 time: 0.155469 Aug 29 19:11:55.868537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 329/660] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:55 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:56.175969 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-578556b7-a8dc-428f-a540-5e5d154b681d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:56.176537 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-578556b7-a8dc-428f-a540-5e5d154b681d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:56.182962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-578556b7-a8dc-428f-a540-5e5d154b681d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:56.183492 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-578556b7-a8dc-428f-a540-5e5d154b681d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:56.183931 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-578556b7-a8dc-428f-a540-5e5d154b681d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:56.184630 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-578556b7-a8dc-428f-a540-5e5d154b681d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:56.185114 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-578556b7-a8dc-428f-a540-5e5d154b681d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:56.185539 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-578556b7-a8dc-428f-a540-5e5d154b681d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:56.317797 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-578556b7-a8dc-428f-a540-5e5d154b681d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:56.325744 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-578556b7-a8dc-428f-a540-5e5d154b681d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1679 microversion: 2.1 time: 0.153875 Aug 29 19:11:56.326321 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 332/661] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:56 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:56.889045 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2dab8358-7f3f-45d9-82bd-05760af405ec tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:56.889641 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2dab8358-7f3f-45d9-82bd-05760af405ec tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:56.896445 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2dab8358-7f3f-45d9-82bd-05760af405ec tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:56.896933 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2dab8358-7f3f-45d9-82bd-05760af405ec tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:56.897375 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2dab8358-7f3f-45d9-82bd-05760af405ec tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:56.898069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2dab8358-7f3f-45d9-82bd-05760af405ec tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:56.898565 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2dab8358-7f3f-45d9-82bd-05760af405ec tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:56.898995 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2dab8358-7f3f-45d9-82bd-05760af405ec tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:57.028007 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2dab8358-7f3f-45d9-82bd-05760af405ec tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:57.035783 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2dab8358-7f3f-45d9-82bd-05760af405ec tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1684 microversion: 2.1 time: 0.150685 Aug 29 19:11:57.036348 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 330/662] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:56 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:57.347033 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-130fe104-8a8b-49cf-8f6f-a164e8fcbe57 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:57.347678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-130fe104-8a8b-49cf-8f6f-a164e8fcbe57 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:57.349729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:11:57.355174 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-130fe104-8a8b-49cf-8f6f-a164e8fcbe57 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:57.355669 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-130fe104-8a8b-49cf-8f6f-a164e8fcbe57 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:57.356111 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-130fe104-8a8b-49cf-8f6f-a164e8fcbe57 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:57.356816 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-130fe104-8a8b-49cf-8f6f-a164e8fcbe57 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:57.357283 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-130fe104-8a8b-49cf-8f6f-a164e8fcbe57 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:57.357708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-130fe104-8a8b-49cf-8f6f-a164e8fcbe57 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:57.493116 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-130fe104-8a8b-49cf-8f6f-a164e8fcbe57 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:57.501469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-130fe104-8a8b-49cf-8f6f-a164e8fcbe57 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1656 microversion: 2.1 time: 0.158475 Aug 29 19:11:57.502044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 333/663] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:57 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1656 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:57.522207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-251086d5-bb97-430c-a5da-be3d57cad721 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:57.528254 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-251086d5-bb97-430c-a5da-be3d57cad721 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:57.528737 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-251086d5-bb97-430c-a5da-be3d57cad721 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:57.529174 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-251086d5-bb97-430c-a5da-be3d57cad721 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:57.551746 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-251086d5-bb97-430c-a5da-be3d57cad721 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Going to try to start instance {{(pid=115968) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 19:11:57.594800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-251086d5-bb97-430c-a5da-be3d57cad721 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "POST /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/action" status: 202 len: 0 microversion: 2.1 time: 0.076345 Aug 29 19:11:57.595604 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 331/664] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:11:57 2022] POST /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:11:57.603665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-720ff398-8309-45ac-bf00-545e69b715df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:57.604216 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-720ff398-8309-45ac-bf00-545e69b715df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:57.610134 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720ff398-8309-45ac-bf00-545e69b715df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:57.610622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720ff398-8309-45ac-bf00-545e69b715df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:57.611061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720ff398-8309-45ac-bf00-545e69b715df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:57.611776 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720ff398-8309-45ac-bf00-545e69b715df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:57.612865 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720ff398-8309-45ac-bf00-545e69b715df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:57.613300 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-720ff398-8309-45ac-bf00-545e69b715df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:57.751425 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-720ff398-8309-45ac-bf00-545e69b715df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:57.760720 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-720ff398-8309-45ac-bf00-545e69b715df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1665 microversion: 2.1 time: 0.160882 Aug 29 19:11:57.761506 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 334/665] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:57 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:58.058118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3a4b405e-d931-4fb1-8253-78d5fc25e0e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:58.058803 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3a4b405e-d931-4fb1-8253-78d5fc25e0e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:58.064824 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a4b405e-d931-4fb1-8253-78d5fc25e0e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:58.065380 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a4b405e-d931-4fb1-8253-78d5fc25e0e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:58.065852 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a4b405e-d931-4fb1-8253-78d5fc25e0e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:58.066647 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a4b405e-d931-4fb1-8253-78d5fc25e0e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:58.067122 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a4b405e-d931-4fb1-8253-78d5fc25e0e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:58.067542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a4b405e-d931-4fb1-8253-78d5fc25e0e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:58.200527 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3a4b405e-d931-4fb1-8253-78d5fc25e0e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:58.208940 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3a4b405e-d931-4fb1-8253-78d5fc25e0e9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1684 microversion: 2.1 time: 0.155569 Aug 29 19:11:58.209515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 332/666] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:58 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:58.781572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e6a44e48-7b5e-42d4-bf0f-139874b0b01b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:58.782183 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e6a44e48-7b5e-42d4-bf0f-139874b0b01b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:58.788837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6a44e48-7b5e-42d4-bf0f-139874b0b01b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:58.789324 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6a44e48-7b5e-42d4-bf0f-139874b0b01b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:58.789761 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6a44e48-7b5e-42d4-bf0f-139874b0b01b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:58.790454 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6a44e48-7b5e-42d4-bf0f-139874b0b01b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:58.790914 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6a44e48-7b5e-42d4-bf0f-139874b0b01b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:58.791468 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6a44e48-7b5e-42d4-bf0f-139874b0b01b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:58.921932 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e6a44e48-7b5e-42d4-bf0f-139874b0b01b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:58.929756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e6a44e48-7b5e-42d4-bf0f-139874b0b01b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1665 microversion: 2.1 time: 0.152110 Aug 29 19:11:58.930326 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 335/667] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:58 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:59.229744 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7d9632de-fcc4-42c6-a198-c9bb46fccce8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:59.230402 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7d9632de-fcc4-42c6-a198-c9bb46fccce8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:59.236943 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d9632de-fcc4-42c6-a198-c9bb46fccce8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:59.238019 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d9632de-fcc4-42c6-a198-c9bb46fccce8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:59.238569 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d9632de-fcc4-42c6-a198-c9bb46fccce8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:59.239311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d9632de-fcc4-42c6-a198-c9bb46fccce8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:59.239766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d9632de-fcc4-42c6-a198-c9bb46fccce8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:59.240189 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7d9632de-fcc4-42c6-a198-c9bb46fccce8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:59.300268 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2b49d03b-dd66-4291-b3fa-18a9ec3efbcb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ddf66ca-3b19-4b38-83a1-ec6ae7262f8c"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:11:59.302856 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2b49d03b-dd66-4291-b3fa-18a9ec3efbcb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:59.308864 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2b49d03b-dd66-4291-b3fa-18a9ec3efbcb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:59.309392 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2b49d03b-dd66-4291-b3fa-18a9ec3efbcb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:59.309831 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2b49d03b-dd66-4291-b3fa-18a9ec3efbcb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:59.310534 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2b49d03b-dd66-4291-b3fa-18a9ec3efbcb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:59.310991 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2b49d03b-dd66-4291-b3fa-18a9ec3efbcb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:59.311442 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2b49d03b-dd66-4291-b3fa-18a9ec3efbcb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:59.377131 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7d9632de-fcc4-42c6-a198-c9bb46fccce8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:11:59.385311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7d9632de-fcc4-42c6-a198-c9bb46fccce8 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1684 microversion: 2.1 time: 0.159392 Aug 29 19:11:59.385870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 333/668] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:59 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:11:59.952323 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8a786c40-3e91-48ea-b369-05baa92b8aa5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:11:59.952842 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8a786c40-3e91-48ea-b369-05baa92b8aa5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:11:59.958905 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8a786c40-3e91-48ea-b369-05baa92b8aa5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:59.959424 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8a786c40-3e91-48ea-b369-05baa92b8aa5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:59.959861 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8a786c40-3e91-48ea-b369-05baa92b8aa5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:11:59.960553 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8a786c40-3e91-48ea-b369-05baa92b8aa5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:11:59.961005 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8a786c40-3e91-48ea-b369-05baa92b8aa5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:11:59.961556 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8a786c40-3e91-48ea-b369-05baa92b8aa5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:00.118459 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8a786c40-3e91-48ea-b369-05baa92b8aa5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:00.126539 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8a786c40-3e91-48ea-b369-05baa92b8aa5 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1665 microversion: 2.1 time: 0.178108 Aug 29 19:12:00.127134 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 334/669] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:11:59 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:00.406753 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c68fe7c7-e1d5-4da5-aeed-85cfb044a441 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:00.407499 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c68fe7c7-e1d5-4da5-aeed-85cfb044a441 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:00.414718 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c68fe7c7-e1d5-4da5-aeed-85cfb044a441 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:00.415290 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c68fe7c7-e1d5-4da5-aeed-85cfb044a441 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:00.415754 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c68fe7c7-e1d5-4da5-aeed-85cfb044a441 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:00.416445 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c68fe7c7-e1d5-4da5-aeed-85cfb044a441 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:00.416902 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c68fe7c7-e1d5-4da5-aeed-85cfb044a441 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:00.417327 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c68fe7c7-e1d5-4da5-aeed-85cfb044a441 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:00.547622 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c68fe7c7-e1d5-4da5-aeed-85cfb044a441 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:00.555893 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c68fe7c7-e1d5-4da5-aeed-85cfb044a441 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1684 microversion: 2.1 time: 0.152996 Aug 29 19:12:00.556476 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 335/670] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:00 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:01.148766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fbb07948-46fd-4089-a233-ce578d6e9666 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:01.149295 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fbb07948-46fd-4089-a233-ce578d6e9666 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:01.155782 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fbb07948-46fd-4089-a233-ce578d6e9666 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:01.156275 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fbb07948-46fd-4089-a233-ce578d6e9666 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:01.156717 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fbb07948-46fd-4089-a233-ce578d6e9666 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:01.157421 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fbb07948-46fd-4089-a233-ce578d6e9666 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:01.157885 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fbb07948-46fd-4089-a233-ce578d6e9666 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:01.158310 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fbb07948-46fd-4089-a233-ce578d6e9666 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:01.294981 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fbb07948-46fd-4089-a233-ce578d6e9666 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:01.303764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fbb07948-46fd-4089-a233-ce578d6e9666 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1665 microversion: 2.1 time: 0.159431 Aug 29 19:12:01.304360 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 336/671] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:01 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:01.576737 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-00032958-3ffe-437f-8c20-3650adf9cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:01.577415 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-00032958-3ffe-437f-8c20-3650adf9cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:01.584491 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00032958-3ffe-437f-8c20-3650adf9cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:01.584982 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00032958-3ffe-437f-8c20-3650adf9cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:01.585425 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00032958-3ffe-437f-8c20-3650adf9cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:01.586121 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00032958-3ffe-437f-8c20-3650adf9cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:01.586574 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00032958-3ffe-437f-8c20-3650adf9cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:01.586996 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-00032958-3ffe-437f-8c20-3650adf9cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:01.717517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-00032958-3ffe-437f-8c20-3650adf9cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:01.726117 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-00032958-3ffe-437f-8c20-3650adf9cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1684 microversion: 2.1 time: 0.153143 Aug 29 19:12:01.726689 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 337/672] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:01 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:02.180519 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2b49d03b-dd66-4291-b3fa-18a9ec3efbcb tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "POST /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.883788 Aug 29 19:12:02.182454 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 336/673] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:11:59 2022] POST /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments => generated 194 bytes in 2887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:12:02.334515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a51d0e5d-ad07-4ea1-a266-42ea7ad21888 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:02.335045 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a51d0e5d-ad07-4ea1-a266-42ea7ad21888 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:02.351417 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a51d0e5d-ad07-4ea1-a266-42ea7ad21888 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:02.352193 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a51d0e5d-ad07-4ea1-a266-42ea7ad21888 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:02.353007 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a51d0e5d-ad07-4ea1-a266-42ea7ad21888 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:02.354297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a51d0e5d-ad07-4ea1-a266-42ea7ad21888 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:02.354926 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a51d0e5d-ad07-4ea1-a266-42ea7ad21888 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:02.355900 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a51d0e5d-ad07-4ea1-a266-42ea7ad21888 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:02.609695 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a51d0e5d-ad07-4ea1-a266-42ea7ad21888 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:02.618038 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a51d0e5d-ad07-4ea1-a266-42ea7ad21888 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1665 microversion: 2.1 time: 0.293330 Aug 29 19:12:02.618620 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 338/674] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:02 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1665 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:02.748690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-af9f8f6d-4bc2-4d3c-86b7-3e0cb5eb4417 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:02.749449 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-af9f8f6d-4bc2-4d3c-86b7-3e0cb5eb4417 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:02.757491 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-af9f8f6d-4bc2-4d3c-86b7-3e0cb5eb4417 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:02.758094 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-af9f8f6d-4bc2-4d3c-86b7-3e0cb5eb4417 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:02.758519 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-af9f8f6d-4bc2-4d3c-86b7-3e0cb5eb4417 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:02.759255 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-af9f8f6d-4bc2-4d3c-86b7-3e0cb5eb4417 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:02.759713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-af9f8f6d-4bc2-4d3c-86b7-3e0cb5eb4417 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:02.760155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-af9f8f6d-4bc2-4d3c-86b7-3e0cb5eb4417 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:02.828634 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-af9f8f6d-4bc2-4d3c-86b7-3e0cb5eb4417 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:02.836943 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-af9f8f6d-4bc2-4d3c-86b7-3e0cb5eb4417 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1616 microversion: 2.1 time: 0.092932 Aug 29 19:12:02.837482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 337/675] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:02 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1616 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:03.104949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-388cbc53-4030-4871-aa61-04dcf9edb1d7 req-06424a67-9302-434e-88b7-02cc7956ae1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f54a0ab-56bd-45b7-9026-0c998c315879", "name": "network-vif-deleted", "tag": "2fadd321-bdd6-4593-985e-4b08308c8b84"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:03.118424 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-388cbc53-4030-4871-aa61-04dcf9edb1d7 req-06424a67-9302-434e-88b7-02cc7956ae1c service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:03.119321 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-388cbc53-4030-4871-aa61-04dcf9edb1d7 req-06424a67-9302-434e-88b7-02cc7956ae1c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:03.119934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-388cbc53-4030-4871-aa61-04dcf9edb1d7 req-06424a67-9302-434e-88b7-02cc7956ae1c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:03.149638 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-388cbc53-4030-4871-aa61-04dcf9edb1d7 req-06424a67-9302-434e-88b7-02cc7956ae1c service nova] Creating event network-vif-deleted:2fadd321-bdd6-4593-985e-4b08308c8b84 for instance 3f54a0ab-56bd-45b7-9026-0c998c315879 on hv-cinder-73126 Aug 29 19:12:03.155023 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-388cbc53-4030-4871-aa61-04dcf9edb1d7 req-06424a67-9302-434e-88b7-02cc7956ae1c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063038 Aug 29 19:12:03.156090 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 339/676] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:03.640294 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-44c9ebd4-0ce3-424b-8373-e563c51abcbe tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:03.641064 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-44c9ebd4-0ce3-424b-8373-e563c51abcbe tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:03.647656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44c9ebd4-0ce3-424b-8373-e563c51abcbe tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:03.648244 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44c9ebd4-0ce3-424b-8373-e563c51abcbe tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:03.648897 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44c9ebd4-0ce3-424b-8373-e563c51abcbe tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:03.649880 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44c9ebd4-0ce3-424b-8373-e563c51abcbe tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:03.650405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44c9ebd4-0ce3-424b-8373-e563c51abcbe tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:03.650989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44c9ebd4-0ce3-424b-8373-e563c51abcbe tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:03.812239 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-44c9ebd4-0ce3-424b-8373-e563c51abcbe tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:03.821123 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-44c9ebd4-0ce3-424b-8373-e563c51abcbe tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1665 microversion: 2.1 time: 0.185430 Aug 29 19:12:03.821714 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 338/677] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:03 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1665 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:03.858379 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:03.859100 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:03.867297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:03.867795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:03.868238 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:03.868974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:03.869451 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:03.869880 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:03.874242 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:03.906275 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:03.906955 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:03.907512 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:03.907877 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lazy-loading 'fault' on Instance uuid 3f54a0ab-56bd-45b7-9026-0c998c315879 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:03.952544 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:03.961542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3c7de8f6-acf5-4e7d-9c19-0dfbca3b1263 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1332 microversion: 2.1 time: 0.107358 Aug 29 19:12:03.962131 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 340/678] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:03 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:04.841922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8d916416-a1c3-4168-8288-2552f54110b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:04.842538 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8d916416-a1c3-4168-8288-2552f54110b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:04.849152 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d916416-a1c3-4168-8288-2552f54110b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:04.849650 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d916416-a1c3-4168-8288-2552f54110b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:04.850092 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d916416-a1c3-4168-8288-2552f54110b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:04.850787 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d916416-a1c3-4168-8288-2552f54110b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:04.851290 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d916416-a1c3-4168-8288-2552f54110b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:04.851721 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8d916416-a1c3-4168-8288-2552f54110b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:04.981976 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:04.982567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:04.985080 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=72 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:04.987587 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8d916416-a1c3-4168-8288-2552f54110b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:04.991034 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:04.991595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:04.992030 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:04.992731 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:04.993181 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:04.993602 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:04.996347 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8d916416-a1c3-4168-8288-2552f54110b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1669 microversion: 2.1 time: 0.158337 Aug 29 19:12:04.997006 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 339/679] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:04 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1669 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:05.027297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:05.027922 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:05.028349 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:05.028794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lazy-loading 'fault' on Instance uuid 3f54a0ab-56bd-45b7-9026-0c998c315879 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:05.069680 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:05.077303 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-668b95d3-82e1-4a36-80eb-54fe2c09d8bb tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 200 len: 1332 microversion: 2.1 time: 0.099283 Aug 29 19:12:05.077874 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 341/680] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:04 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:05.525005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bcaada49-209a-4c3a-b8b4-575351b86451 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:05.525505 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bcaada49-209a-4c3a-b8b4-575351b86451 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:05.531428 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bcaada49-209a-4c3a-b8b4-575351b86451 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:05.531918 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bcaada49-209a-4c3a-b8b4-575351b86451 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:05.532355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bcaada49-209a-4c3a-b8b4-575351b86451 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:05.533044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bcaada49-209a-4c3a-b8b4-575351b86451 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:05.533503 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bcaada49-209a-4c3a-b8b4-575351b86451 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:05.533929 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bcaada49-209a-4c3a-b8b4-575351b86451 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:05.614092 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-bcaada49-209a-4c3a-b8b4-575351b86451 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lazy-loading 'services' on Instance uuid 693efce1-e294-4292-9e4c-289b5a18e7e7 {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:05.690712 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bcaada49-209a-4c3a-b8b4-575351b86451 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "DELETE /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7/os-volume_attachments/fd971d99-fd20-4a7f-a216-e5041c805c69" status: 202 len: 0 microversion: 2.1 time: 0.170172 Aug 29 19:12:05.691370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 340/681] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:12:05 2022] DELETE /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7/os-volume_attachments/fd971d99-fd20-4a7f-a216-e5041c805c69 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:12:06.098394 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:06.099041 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:06.106054 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:06.106543 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:06.106983 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:06.107701 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:06.108159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:06.108587 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:06.123715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 HTTP/1.1 Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:12:06.125334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:12:06.126741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '3f54a0ab-56bd-45b7-9026-0c998c315879'} Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:12:06.127518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:12:06.128964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:12:06.130278 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:12:06.130278 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-13e516c7-2077-4d9c-9bb5-3f2c53ee572b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 404 len: 111 microversion: 2.1 time: 0.032385 Aug 29 19:12:06.130278 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 342/682] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:06 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:12:06.136566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7942112f-2c05-4d6f-83af-b40f890d6477 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '.version_select at 0x7f3d764873a0>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:06.154892 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7942112f-2c05-4d6f-83af-b40f890d6477 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260835233" status: 202 len: 0 microversion: 2.1 time: 0.022665 Aug 29 19:12:06.155497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 341/683] 10.222.0.94 () {58 vars in 1221 bytes} [Mon Aug 29 19:12:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1260835233 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:12:06.797172 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-63cd0aad-1bdc-4b78-a1fa-e6d7387e498d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: .version_select at 0x7f3d76406af0>, body: {"keypair": {"name": "tempest-keypair-2130768746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhhWxdwN2YtFmus0iWkebn9uPDyALzpIhwjG0+R8hDxofN9e7PdwWttupMbTUxm+OGT15FY6odNl4vXrUnGKNeEpB0m2LgUjudH2KIhtqWx3GOnC0kzflSIDFS2EVn3aA=="}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:06.819427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-63cd0aad-1bdc-4b78-a1fa-e6d7387e498d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for project b967c22662da47aeb9292704c39b44bb. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:12:06.823621 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-63cd0aad-1bdc-4b78-a1fa-e6d7387e498d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for user ac0bc9e010d044a5a2147010cbdb4d85 and project b967c22662da47aeb9292704c39b44bb. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:12:06.846437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-63cd0aad-1bdc-4b78-a1fa-e6d7387e498d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053121 Aug 29 19:12:06.847035 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 343/684] 10.222.0.94 () {60 vars in 1159 bytes} [Mon Aug 29 19:12:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:08.113179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2028449466", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "117b2cb0-1215-4254-9d1f-c2728d00a788"}], "security_groups": [{"name": "tempest-securitygroup--1157266720"}], "key_name": "tempest-keypair-2130768746", "user_data": "}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:08.217878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] validate_networks() for [('117b2cb0-1215-4254-9d1f-c2728d00a788', None, None, None, None, None)] {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:12:08.587662 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:12:08.588089 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:12:08.588594 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:12:08.589004 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:12:08.589424 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:12:08.598403 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:08.598897 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:08.599362 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:08.600726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:08.601505 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:08.601777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:08.608924 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:08.623028 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for project b967c22662da47aeb9292704c39b44bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:12:08.626988 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for user ac0bc9e010d044a5a2147010cbdb4d85 and project b967c22662da47aeb9292704c39b44bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:12:08.638013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:12:08.640493 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:12:08.690182 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3eb6b092-9924-4955-ae95-d6d411cbb02a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.581970 Aug 29 19:12:08.696652 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 342/685] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:12:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:12:08.702306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9b6199ec-1cac-478d-a7cf-c42ff69d5ba6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:08.703005 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9b6199ec-1cac-478d-a7cf-c42ff69d5ba6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:08.756315 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9b6199ec-1cac-478d-a7cf-c42ff69d5ba6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:08.764787 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9b6199ec-1cac-478d-a7cf-c42ff69d5ba6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1242 microversion: 2.1 time: 0.066828 Aug 29 19:12:08.765581 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 344/686] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:08 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:09.787474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-345217e7-6c2a-41dd-a320-b89dcf1dc0f5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:09.788092 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-345217e7-6c2a-41dd-a320-b89dcf1dc0f5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:09.795181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-345217e7-6c2a-41dd-a320-b89dcf1dc0f5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:09.795673 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-345217e7-6c2a-41dd-a320-b89dcf1dc0f5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:09.796113 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-345217e7-6c2a-41dd-a320-b89dcf1dc0f5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:09.796806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-345217e7-6c2a-41dd-a320-b89dcf1dc0f5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:09.797282 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-345217e7-6c2a-41dd-a320-b89dcf1dc0f5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:09.797689 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-345217e7-6c2a-41dd-a320-b89dcf1dc0f5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:09.868086 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-345217e7-6c2a-41dd-a320-b89dcf1dc0f5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:09.877177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-345217e7-6c2a-41dd-a320-b89dcf1dc0f5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1238 microversion: 2.1 time: 0.094055 Aug 29 19:12:09.877846 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 343/687] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:09 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1238 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:10.885788 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-791f9986-32d8-4f26-9491-d46458c88416 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:10.888352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-791f9986-32d8-4f26-9491-d46458c88416 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:10.894833 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-791f9986-32d8-4f26-9491-d46458c88416 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:10.895348 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-791f9986-32d8-4f26-9491-d46458c88416 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:10.895781 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-791f9986-32d8-4f26-9491-d46458c88416 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:10.896530 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-791f9986-32d8-4f26-9491-d46458c88416 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:10.896984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-791f9986-32d8-4f26-9491-d46458c88416 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:10.897405 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-791f9986-32d8-4f26-9491-d46458c88416 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:10.898025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0af7a07a-a826-47c9-bf82-c24bccce84d4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:10.898737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0af7a07a-a826-47c9-bf82-c24bccce84d4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:10.905812 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0af7a07a-a826-47c9-bf82-c24bccce84d4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:10.906394 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0af7a07a-a826-47c9-bf82-c24bccce84d4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:10.906840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0af7a07a-a826-47c9-bf82-c24bccce84d4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:10.907564 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0af7a07a-a826-47c9-bf82-c24bccce84d4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:10.908025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0af7a07a-a826-47c9-bf82-c24bccce84d4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:10.908454 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0af7a07a-a826-47c9-bf82-c24bccce84d4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:10.921455 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-791f9986-32d8-4f26-9491-d46458c88416 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lazy-loading 'flavor' on Instance uuid 0236f3d8-fe14-4ea6-a952-ad43a97260aa {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:10.969885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0af7a07a-a826-47c9-bf82-c24bccce84d4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:10.977621 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0af7a07a-a826-47c9-bf82-c24bccce84d4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1294 microversion: 2.1 time: 0.083758 Aug 29 19:12:10.979113 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 344/688] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:10 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:11.054816 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-791f9986-32d8-4f26-9491-d46458c88416 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "POST /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/action" status: 200 len: 32 microversion: 2.1 time: 0.173022 Aug 29 19:12:11.055683 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 345/689] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:12:10 2022] POST /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:12:11.064936 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-df3328a3-6e8c-4fa3-89d6-0063899c6a99 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:11.065578 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-df3328a3-6e8c-4fa3-89d6-0063899c6a99 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:11.071595 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df3328a3-6e8c-4fa3-89d6-0063899c6a99 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:11.072247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df3328a3-6e8c-4fa3-89d6-0063899c6a99 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:11.072691 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df3328a3-6e8c-4fa3-89d6-0063899c6a99 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:11.073390 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df3328a3-6e8c-4fa3-89d6-0063899c6a99 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:11.073858 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df3328a3-6e8c-4fa3-89d6-0063899c6a99 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:11.074288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-df3328a3-6e8c-4fa3-89d6-0063899c6a99 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:11.207516 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-df3328a3-6e8c-4fa3-89d6-0063899c6a99 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:11.219172 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-df3328a3-6e8c-4fa3-89d6-0063899c6a99 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.157997 Aug 29 19:12:11.219760 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 345/690] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:11 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:11.999193 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e343e139-e397-48ee-9edd-e24a74bef27b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:12.000048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e343e139-e397-48ee-9edd-e24a74bef27b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:12.006580 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e343e139-e397-48ee-9edd-e24a74bef27b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.007240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e343e139-e397-48ee-9edd-e24a74bef27b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.007636 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e343e139-e397-48ee-9edd-e24a74bef27b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.008344 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e343e139-e397-48ee-9edd-e24a74bef27b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.008974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e343e139-e397-48ee-9edd-e24a74bef27b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.009562 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e343e139-e397-48ee-9edd-e24a74bef27b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.084132 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e343e139-e397-48ee-9edd-e24a74bef27b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:12.094999 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e343e139-e397-48ee-9edd-e24a74bef27b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1300 microversion: 2.1 time: 0.100749 Aug 29 19:12:12.096122 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 346/691] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:11 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1300 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:12.129805 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e60556d0-9f21-45cc-b670-28e0407285bf tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:12.130367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e60556d0-9f21-45cc-b670-28e0407285bf tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:12.137352 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e60556d0-9f21-45cc-b670-28e0407285bf tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.137851 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e60556d0-9f21-45cc-b670-28e0407285bf tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.138477 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e60556d0-9f21-45cc-b670-28e0407285bf tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.139427 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e60556d0-9f21-45cc-b670-28e0407285bf tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.139906 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e60556d0-9f21-45cc-b670-28e0407285bf tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.140312 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e60556d0-9f21-45cc-b670-28e0407285bf tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.171530 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e60556d0-9f21-45cc-b670-28e0407285bf tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:12:12.241568 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f876502e-12cb-4fd1-9149-b7c78cc60528 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:12.242175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f876502e-12cb-4fd1-9149-b7c78cc60528 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:12.249720 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f876502e-12cb-4fd1-9149-b7c78cc60528 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.250209 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f876502e-12cb-4fd1-9149-b7c78cc60528 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.256267 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f876502e-12cb-4fd1-9149-b7c78cc60528 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.257312 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f876502e-12cb-4fd1-9149-b7c78cc60528 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.258015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f876502e-12cb-4fd1-9149-b7c78cc60528 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.259509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f876502e-12cb-4fd1-9149-b7c78cc60528 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.269410 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e60556d0-9f21-45cc-b670-28e0407285bf tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "DELETE /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 204 len: 0 microversion: 2.1 time: 0.142673 Aug 29 19:12:12.271333 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 346/692] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:12:12 2022] DELETE /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:12:12.289512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f0896faf-6b6f-449f-baad-71ac57a78c60 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:12.291836 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f0896faf-6b6f-449f-baad-71ac57a78c60 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:12.299632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f0896faf-6b6f-449f-baad-71ac57a78c60 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.300311 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f0896faf-6b6f-449f-baad-71ac57a78c60 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.300867 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f0896faf-6b6f-449f-baad-71ac57a78c60 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.301717 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f0896faf-6b6f-449f-baad-71ac57a78c60 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:12.302388 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f0896faf-6b6f-449f-baad-71ac57a78c60 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:12.302920 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f0896faf-6b6f-449f-baad-71ac57a78c60 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:12.668909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f0896faf-6b6f-449f-baad-71ac57a78c60 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:12.676419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f876502e-12cb-4fd1-9149-b7c78cc60528 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:12.676909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f0896faf-6b6f-449f-baad-71ac57a78c60 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1514 microversion: 2.1 time: 0.395142 Aug 29 19:12:12.677553 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 347/693] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:12 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1514 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:12.685662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f876502e-12cb-4fd1-9149-b7c78cc60528 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.447935 Aug 29 19:12:12.686538 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 347/694] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:12 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:13.130421 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5cc4058e-af53-446c-a2c2-fd294389df39 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:13.131027 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5cc4058e-af53-446c-a2c2-fd294389df39 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:13.138828 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5cc4058e-af53-446c-a2c2-fd294389df39 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:13.139342 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5cc4058e-af53-446c-a2c2-fd294389df39 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:13.139774 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5cc4058e-af53-446c-a2c2-fd294389df39 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:13.140463 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5cc4058e-af53-446c-a2c2-fd294389df39 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:13.140913 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5cc4058e-af53-446c-a2c2-fd294389df39 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:13.141331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5cc4058e-af53-446c-a2c2-fd294389df39 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:13.293239 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5cc4058e-af53-446c-a2c2-fd294389df39 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:13.301069 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5cc4058e-af53-446c-a2c2-fd294389df39 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1368 microversion: 2.1 time: 0.174570 Aug 29 19:12:13.301655 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 348/695] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:13 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:13.699763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b360d379-ce87-4bc1-9ab7-c3e1a61a3625 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:13.700378 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b360d379-ce87-4bc1-9ab7-c3e1a61a3625 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:13.706610 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b360d379-ce87-4bc1-9ab7-c3e1a61a3625 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:13.707119 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b360d379-ce87-4bc1-9ab7-c3e1a61a3625 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:13.707428 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0046bad2-9376-40eb-aa47-8b8100a45533 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:13.707559 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b360d379-ce87-4bc1-9ab7-c3e1a61a3625 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:13.708045 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0046bad2-9376-40eb-aa47-8b8100a45533 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:13.708233 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b360d379-ce87-4bc1-9ab7-c3e1a61a3625 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:13.708680 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b360d379-ce87-4bc1-9ab7-c3e1a61a3625 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:13.709097 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b360d379-ce87-4bc1-9ab7-c3e1a61a3625 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:13.714196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0046bad2-9376-40eb-aa47-8b8100a45533 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:13.714697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0046bad2-9376-40eb-aa47-8b8100a45533 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:13.715157 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0046bad2-9376-40eb-aa47-8b8100a45533 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:13.715868 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0046bad2-9376-40eb-aa47-8b8100a45533 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:13.716327 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0046bad2-9376-40eb-aa47-8b8100a45533 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:13.716754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0046bad2-9376-40eb-aa47-8b8100a45533 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:13.907359 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b360d379-ce87-4bc1-9ab7-c3e1a61a3625 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:13.911356 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0046bad2-9376-40eb-aa47-8b8100a45533 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:13.915374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b360d379-ce87-4bc1-9ab7-c3e1a61a3625 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1514 microversion: 2.1 time: 0.219413 Aug 29 19:12:13.915932 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 348/696] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:13 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1514 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:13.920579 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0046bad2-9376-40eb-aa47-8b8100a45533 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.216897 Aug 29 19:12:13.921177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 349/697] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:13 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:14.321518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1ed8907d-f5b7-4c95-80f4-ffd594c95d55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:14.322207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1ed8907d-f5b7-4c95-80f4-ffd594c95d55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:14.328856 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ed8907d-f5b7-4c95-80f4-ffd594c95d55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:14.329334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ed8907d-f5b7-4c95-80f4-ffd594c95d55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:14.329763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ed8907d-f5b7-4c95-80f4-ffd594c95d55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:14.330447 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ed8907d-f5b7-4c95-80f4-ffd594c95d55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:14.330891 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ed8907d-f5b7-4c95-80f4-ffd594c95d55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:14.331334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1ed8907d-f5b7-4c95-80f4-ffd594c95d55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:14.535794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1ed8907d-f5b7-4c95-80f4-ffd594c95d55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:14.544475 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1ed8907d-f5b7-4c95-80f4-ffd594c95d55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1368 microversion: 2.1 time: 0.226766 Aug 29 19:12:14.545385 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 349/698] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:14 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:14.772472 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-cf4b426c-23a3-4086-b3fa-57dcfee7b48a req-446df9bf-1be8-478c-86c6-a413e1a5c0fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ddcbed3-129a-497b-aefb-a8a42ad2aec6", "tag": "547abed6-9c9a-44ab-8528-0a763a1230f2"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:14.785358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-cf4b426c-23a3-4086-b3fa-57dcfee7b48a req-446df9bf-1be8-478c-86c6-a413e1a5c0fb service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:14.786096 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-cf4b426c-23a3-4086-b3fa-57dcfee7b48a req-446df9bf-1be8-478c-86c6-a413e1a5c0fb service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:14.786766 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-cf4b426c-23a3-4086-b3fa-57dcfee7b48a req-446df9bf-1be8-478c-86c6-a413e1a5c0fb service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:14.800918 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-cf4b426c-23a3-4086-b3fa-57dcfee7b48a req-446df9bf-1be8-478c-86c6-a413e1a5c0fb service nova] Creating event network-changed:547abed6-9c9a-44ab-8528-0a763a1230f2 for instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 on hv-cinder-73126 Aug 29 19:12:14.806419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-cf4b426c-23a3-4086-b3fa-57dcfee7b48a req-446df9bf-1be8-478c-86c6-a413e1a5c0fb service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037508 Aug 29 19:12:14.807993 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 350/699] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:14.938905 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-abe34f53-458e-4df8-b3ee-3f9ec7d8e785 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:14.940384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-abe34f53-458e-4df8-b3ee-3f9ec7d8e785 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:14.942276 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-75ede649-897b-4ccb-a691-bd3f1fafe6a3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:14.943094 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-75ede649-897b-4ccb-a691-bd3f1fafe6a3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:14.952875 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abe34f53-458e-4df8-b3ee-3f9ec7d8e785 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:14.953633 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abe34f53-458e-4df8-b3ee-3f9ec7d8e785 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:14.954345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abe34f53-458e-4df8-b3ee-3f9ec7d8e785 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:14.955498 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abe34f53-458e-4df8-b3ee-3f9ec7d8e785 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:14.956176 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abe34f53-458e-4df8-b3ee-3f9ec7d8e785 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:14.956833 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abe34f53-458e-4df8-b3ee-3f9ec7d8e785 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:14.957183 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75ede649-897b-4ccb-a691-bd3f1fafe6a3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:14.957700 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75ede649-897b-4ccb-a691-bd3f1fafe6a3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:14.958148 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75ede649-897b-4ccb-a691-bd3f1fafe6a3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:14.958881 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75ede649-897b-4ccb-a691-bd3f1fafe6a3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:14.959359 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75ede649-897b-4ccb-a691-bd3f1fafe6a3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:14.959788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-75ede649-897b-4ccb-a691-bd3f1fafe6a3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:15.104771 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-abe34f53-458e-4df8-b3ee-3f9ec7d8e785 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:15.112672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-abe34f53-458e-4df8-b3ee-3f9ec7d8e785 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1472 microversion: 2.1 time: 0.178853 Aug 29 19:12:15.113254 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 350/700] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:14 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1472 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:15.117855 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-6d45236c-c481-413b-b86d-dd3b7f8b86fa req-4c4d8f9d-5415-498f-b4cb-54d3e4955882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "693efce1-e294-4292-9e4c-289b5a18e7e7", "name": "network-vif-deleted", "tag": "97d1e245-1b7b-4037-8040-3f51dfe1009e"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:15.131480 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-6d45236c-c481-413b-b86d-dd3b7f8b86fa req-4c4d8f9d-5415-498f-b4cb-54d3e4955882 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:15.132840 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-6d45236c-c481-413b-b86d-dd3b7f8b86fa req-4c4d8f9d-5415-498f-b4cb-54d3e4955882 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:15.133444 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-6d45236c-c481-413b-b86d-dd3b7f8b86fa req-4c4d8f9d-5415-498f-b4cb-54d3e4955882 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:15.155332 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-6d45236c-c481-413b-b86d-dd3b7f8b86fa req-4c4d8f9d-5415-498f-b4cb-54d3e4955882 service nova] Creating event network-vif-deleted:97d1e245-1b7b-4037-8040-3f51dfe1009e for instance 693efce1-e294-4292-9e4c-289b5a18e7e7 on hv-cinder-73126 Aug 29 19:12:15.160503 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-6d45236c-c481-413b-b86d-dd3b7f8b86fa req-4c4d8f9d-5415-498f-b4cb-54d3e4955882 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045974 Aug 29 19:12:15.161691 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 351/701] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:15.246850 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-75ede649-897b-4ccb-a691-bd3f1fafe6a3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:15.255512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-75ede649-897b-4ccb-a691-bd3f1fafe6a3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.318292 Aug 29 19:12:15.270459 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 351/702] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:14 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:15.566448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8e652133-ec10-4223-ace0-57175a8b1b55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:15.567178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8e652133-ec10-4223-ace0-57175a8b1b55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:15.573518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e652133-ec10-4223-ace0-57175a8b1b55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:15.574010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e652133-ec10-4223-ace0-57175a8b1b55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:15.574952 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e652133-ec10-4223-ace0-57175a8b1b55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:15.575676 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e652133-ec10-4223-ace0-57175a8b1b55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:15.576131 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e652133-ec10-4223-ace0-57175a8b1b55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:15.576555 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e652133-ec10-4223-ace0-57175a8b1b55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:15.706844 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8e652133-ec10-4223-ace0-57175a8b1b55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:15.714662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8e652133-ec10-4223-ace0-57175a8b1b55 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1368 microversion: 2.1 time: 0.152524 Aug 29 19:12:15.715266 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 352/703] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:15 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:16.134460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:16.135808 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:16.142670 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.143198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.143643 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.144338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.144796 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.145225 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.175856 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.176332 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.176773 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.177214 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lazy-loading 'fault' on Instance uuid 693efce1-e294-4292-9e4c-289b5a18e7e7 {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:16.219743 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:16.227386 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fb96f205-bfa2-4e98-a5cf-dbd48d483022 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1309 microversion: 2.1 time: 0.096825 Aug 29 19:12:16.227953 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 352/704] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:16 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:16.277472 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-eaf5808d-495c-4437-a9cf-5fcab79beed6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:16.278081 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-eaf5808d-495c-4437-a9cf-5fcab79beed6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:16.284710 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eaf5808d-495c-4437-a9cf-5fcab79beed6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.285243 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eaf5808d-495c-4437-a9cf-5fcab79beed6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.285674 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eaf5808d-495c-4437-a9cf-5fcab79beed6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.286387 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eaf5808d-495c-4437-a9cf-5fcab79beed6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.286834 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eaf5808d-495c-4437-a9cf-5fcab79beed6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.287283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eaf5808d-495c-4437-a9cf-5fcab79beed6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.420944 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-eaf5808d-495c-4437-a9cf-5fcab79beed6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:16.429057 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-eaf5808d-495c-4437-a9cf-5fcab79beed6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.155521 Aug 29 19:12:16.429629 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 353/705] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:16 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:16.736218 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-154a4227-0490-42d0-bd25-ee630064f725 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:16.736830 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-154a4227-0490-42d0-bd25-ee630064f725 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:16.742764 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-154a4227-0490-42d0-bd25-ee630064f725 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.743465 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-154a4227-0490-42d0-bd25-ee630064f725 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.743907 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-154a4227-0490-42d0-bd25-ee630064f725 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.745309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-154a4227-0490-42d0-bd25-ee630064f725 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:16.745773 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-154a4227-0490-42d0-bd25-ee630064f725 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:16.746203 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-154a4227-0490-42d0-bd25-ee630064f725 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:16.908932 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-154a4227-0490-42d0-bd25-ee630064f725 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:16.917537 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-154a4227-0490-42d0-bd25-ee630064f725 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1368 microversion: 2.1 time: 0.185253 Aug 29 19:12:16.918139 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 353/706] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:16 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:17.248557 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:17.249246 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:17.255855 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.256478 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.256777 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.257607 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.258716 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.258716 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.296576 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.297702 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.298153 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.298816 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lazy-loading 'fault' on Instance uuid 693efce1-e294-4292-9e4c-289b5a18e7e7 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:17.358084 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '985dfcc7246c45b5b470e07957cd2f49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778d0dad05594da5bb3cb0e2efcb2af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:17.364919 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-82682218-2cdf-4549-82a4-40e484b44431 tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 200 len: 1309 microversion: 2.1 time: 0.120660 Aug 29 19:12:17.365497 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 354/707] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:17 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 1309 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:17.451500 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5c57ce81-48cb-4f77-9fe0-cc660a407957 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:17.452048 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5c57ce81-48cb-4f77-9fe0-cc660a407957 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:17.458358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5c57ce81-48cb-4f77-9fe0-cc660a407957 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.458840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5c57ce81-48cb-4f77-9fe0-cc660a407957 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.459313 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5c57ce81-48cb-4f77-9fe0-cc660a407957 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.460011 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5c57ce81-48cb-4f77-9fe0-cc660a407957 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.460463 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5c57ce81-48cb-4f77-9fe0-cc660a407957 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.460886 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5c57ce81-48cb-4f77-9fe0-cc660a407957 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.597458 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5c57ce81-48cb-4f77-9fe0-cc660a407957 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:17.605581 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5c57ce81-48cb-4f77-9fe0-cc660a407957 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.158916 Aug 29 19:12:17.606138 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 354/708] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:17 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:17.938835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ada4d970-91ee-437a-93ba-6c198a42cf2f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:17.939479 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ada4d970-91ee-437a-93ba-6c198a42cf2f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:17.945431 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ada4d970-91ee-437a-93ba-6c198a42cf2f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.945911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ada4d970-91ee-437a-93ba-6c198a42cf2f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.946345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ada4d970-91ee-437a-93ba-6c198a42cf2f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:17.947031 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ada4d970-91ee-437a-93ba-6c198a42cf2f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:17.948083 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ada4d970-91ee-437a-93ba-6c198a42cf2f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:17.948564 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ada4d970-91ee-437a-93ba-6c198a42cf2f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:18.075483 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ada4d970-91ee-437a-93ba-6c198a42cf2f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:18.083038 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ada4d970-91ee-437a-93ba-6c198a42cf2f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1368 microversion: 2.1 time: 0.148204 Aug 29 19:12:18.083632 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 355/709] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:17 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:18.385733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:18.386256 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] [instance: 693efce1-e294-4292-9e4c-289b5a18e7e7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:18.392869 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:18.393357 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:18.393795 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:18.394493 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:18.394987 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:18.395444 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:18.408964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] HTTP exception thrown: Instance 693efce1-e294-4292-9e4c-289b5a18e7e7 could not be found. Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Request method failure captured: Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 HTTP/1.1 Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ7m1LGYIEP7EttH17L1UfI0ySMzsS4MQv5fr1Yr26_rJSrBg8d1h2fyLXOKgWepZXZZ6_oW-usD4jUCST2IsrebQRo5n3HjnQ0bRCtfHvre_vvnQz6IoOBBUBDg08-Wj0clYhysyL9F6JjVY34NaZLXaWgoGjuRGj_Lzs-VkImpiRQ Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 778d0dad05594da5bb3cb0e2efcb2af5 Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-VolumesSnapshotTestJSON-457066779 Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:12:18.410603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/778d0dad05594da5bb3cb0e2efcb2af5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_778d0dad05594da5bb3cb0e2efcb2af5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/778d0dad05594da5bb3cb0e2efcb2af5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/778d0dad05594da5bb3cb0e2efcb2af5"}]}] Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-VolumesSnapshotTestJSON-457066779 Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 778d0dad05594da5bb3cb0e2efcb2af5 Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-457066779 Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-VolumesSnapshotTestJSON-457066779-project Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 985dfcc7246c45b5b470e07957cd2f49 Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-VolumesSnapshotTestJSON-457066779-project Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 693efce1-e294-4292-9e4c-289b5a18e7e7 could not be found. Aug 29 19:12:18.412208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '693efce1-e294-4292-9e4c-289b5a18e7e7'} Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 693efce1-e294-4292-9e4c-289b5a18e7e7 could not be found. Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:12:18.413101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 693efce1-e294-4292-9e4c-289b5a18e7e7 could not be found. Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 693efce1-e294-4292-9e4c-289b5a18e7e7 could not be found. Aug 29 19:12:18.414967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:12:18.416299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] Returning 404 to user: Instance 693efce1-e294-4292-9e4c-289b5a18e7e7 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:12:18.416299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0ca622bf-e222-4a56-b9d3-2ee81526300e tempest-VolumesSnapshotTestJSON-457066779 tempest-VolumesSnapshotTestJSON-457066779-project] 10.222.0.94 "GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7" status: 404 len: 111 microversion: 2.1 time: 0.030322 Aug 29 19:12:18.416299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 355/710] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:18 2022] GET /compute/v2.1/servers/693efce1-e294-4292-9e4c-289b5a18e7e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:12:18.627442 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-734093e2-0d5d-4d71-94dc-093e3d3be0b2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:18.628070 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-734093e2-0d5d-4d71-94dc-093e3d3be0b2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:18.635177 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-734093e2-0d5d-4d71-94dc-093e3d3be0b2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:18.635685 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-734093e2-0d5d-4d71-94dc-093e3d3be0b2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:18.636294 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-734093e2-0d5d-4d71-94dc-093e3d3be0b2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:18.637081 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-734093e2-0d5d-4d71-94dc-093e3d3be0b2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:18.637569 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-734093e2-0d5d-4d71-94dc-093e3d3be0b2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:18.638093 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-734093e2-0d5d-4d71-94dc-093e3d3be0b2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:18.764065 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=6 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:18.790159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-734093e2-0d5d-4d71-94dc-093e3d3be0b2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:18.799532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-734093e2-0d5d-4d71-94dc-093e3d3be0b2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.176945 Aug 29 19:12:18.800395 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 356/711] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:18 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:19.106555 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-083a6312-473f-4105-875d-95a12c3bdfd1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:19.107274 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-083a6312-473f-4105-875d-95a12c3bdfd1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:19.110731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:19.111842 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=6 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:19.121974 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-083a6312-473f-4105-875d-95a12c3bdfd1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:19.122466 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-083a6312-473f-4105-875d-95a12c3bdfd1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:19.122901 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-083a6312-473f-4105-875d-95a12c3bdfd1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:19.123637 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-083a6312-473f-4105-875d-95a12c3bdfd1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:19.124091 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-083a6312-473f-4105-875d-95a12c3bdfd1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:19.124511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-083a6312-473f-4105-875d-95a12c3bdfd1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:19.262865 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-083a6312-473f-4105-875d-95a12c3bdfd1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:19.271608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-083a6312-473f-4105-875d-95a12c3bdfd1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1368 microversion: 2.1 time: 0.171271 Aug 29 19:12:19.272183 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 356/712] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:19 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:19.821764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-29009210-7889-48c0-afe5-fa5863793db2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:19.822363 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-29009210-7889-48c0-afe5-fa5863793db2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:19.829205 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29009210-7889-48c0-afe5-fa5863793db2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:19.829904 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29009210-7889-48c0-afe5-fa5863793db2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:19.830499 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29009210-7889-48c0-afe5-fa5863793db2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:19.831522 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29009210-7889-48c0-afe5-fa5863793db2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:19.831971 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29009210-7889-48c0-afe5-fa5863793db2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:19.832386 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-29009210-7889-48c0-afe5-fa5863793db2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:19.836687 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:19.980761 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-29009210-7889-48c0-afe5-fa5863793db2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:19.988956 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-29009210-7889-48c0-afe5-fa5863793db2 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.170952 Aug 29 19:12:19.989523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 357/713] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:19 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:20.295054 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-30f4aa4f-63bf-4bec-beb8-2d9965f363ba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:20.295809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-30f4aa4f-63bf-4bec-beb8-2d9965f363ba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:20.302241 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30f4aa4f-63bf-4bec-beb8-2d9965f363ba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:20.302723 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30f4aa4f-63bf-4bec-beb8-2d9965f363ba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:20.303195 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30f4aa4f-63bf-4bec-beb8-2d9965f363ba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:20.303885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30f4aa4f-63bf-4bec-beb8-2d9965f363ba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:20.304341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30f4aa4f-63bf-4bec-beb8-2d9965f363ba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:20.304764 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-30f4aa4f-63bf-4bec-beb8-2d9965f363ba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:20.436151 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-30f4aa4f-63bf-4bec-beb8-2d9965f363ba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:20.443732 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-30f4aa4f-63bf-4bec-beb8-2d9965f363ba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1368 microversion: 2.1 time: 0.154493 Aug 29 19:12:20.444294 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 357/714] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:20 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:21.009758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9fe8a911-ae7c-4d5b-9069-bd4487e16e26 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:21.010406 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9fe8a911-ae7c-4d5b-9069-bd4487e16e26 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:21.016776 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9fe8a911-ae7c-4d5b-9069-bd4487e16e26 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:21.017367 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9fe8a911-ae7c-4d5b-9069-bd4487e16e26 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:21.017746 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9fe8a911-ae7c-4d5b-9069-bd4487e16e26 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:21.018708 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9fe8a911-ae7c-4d5b-9069-bd4487e16e26 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:21.019195 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9fe8a911-ae7c-4d5b-9069-bd4487e16e26 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:21.019621 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9fe8a911-ae7c-4d5b-9069-bd4487e16e26 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:21.146536 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9fe8a911-ae7c-4d5b-9069-bd4487e16e26 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:21.155156 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9fe8a911-ae7c-4d5b-9069-bd4487e16e26 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.149239 Aug 29 19:12:21.155799 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 358/715] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:21 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:21.465483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-32a9daaa-7b61-40ea-b2cd-a6c6aabde69b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:21.466026 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-32a9daaa-7b61-40ea-b2cd-a6c6aabde69b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:21.472541 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-32a9daaa-7b61-40ea-b2cd-a6c6aabde69b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:21.473026 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-32a9daaa-7b61-40ea-b2cd-a6c6aabde69b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:21.473463 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-32a9daaa-7b61-40ea-b2cd-a6c6aabde69b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:21.474154 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-32a9daaa-7b61-40ea-b2cd-a6c6aabde69b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:21.474625 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-32a9daaa-7b61-40ea-b2cd-a6c6aabde69b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:21.475031 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-32a9daaa-7b61-40ea-b2cd-a6c6aabde69b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:21.607469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-32a9daaa-7b61-40ea-b2cd-a6c6aabde69b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:21.610875 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:21.615513 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-32a9daaa-7b61-40ea-b2cd-a6c6aabde69b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1368 microversion: 2.1 time: 0.154429 Aug 29 19:12:21.616058 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 358/716] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:21 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:22.177834 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ecdb3be8-feed-4ecf-952d-50e64c64c19b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:22.178400 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ecdb3be8-feed-4ecf-952d-50e64c64c19b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:22.185403 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be8-feed-4ecf-952d-50e64c64c19b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:22.185888 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be8-feed-4ecf-952d-50e64c64c19b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:22.186325 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be8-feed-4ecf-952d-50e64c64c19b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:22.187014 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be8-feed-4ecf-952d-50e64c64c19b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:22.187503 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be8-feed-4ecf-952d-50e64c64c19b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:22.187930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecdb3be8-feed-4ecf-952d-50e64c64c19b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:22.316638 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ecdb3be8-feed-4ecf-952d-50e64c64c19b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:22.325382 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ecdb3be8-feed-4ecf-952d-50e64c64c19b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.151507 Aug 29 19:12:22.325953 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 359/717] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:22 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:22.636361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7404fd5d-a663-4ba7-983d-435829511ae6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:22.637000 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7404fd5d-a663-4ba7-983d-435829511ae6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:22.644033 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7404fd5d-a663-4ba7-983d-435829511ae6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:22.644523 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7404fd5d-a663-4ba7-983d-435829511ae6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:22.644967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7404fd5d-a663-4ba7-983d-435829511ae6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:22.645656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7404fd5d-a663-4ba7-983d-435829511ae6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:22.646116 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7404fd5d-a663-4ba7-983d-435829511ae6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:22.646543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7404fd5d-a663-4ba7-983d-435829511ae6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:22.776031 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7404fd5d-a663-4ba7-983d-435829511ae6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:22.784280 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7404fd5d-a663-4ba7-983d-435829511ae6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1368 microversion: 2.1 time: 0.152163 Aug 29 19:12:22.784857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 359/718] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:22 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:23.346991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a43b0abc-4117-41f7-9f51-9e58c0961f1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:23.347636 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a43b0abc-4117-41f7-9f51-9e58c0961f1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:23.354100 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a43b0abc-4117-41f7-9f51-9e58c0961f1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:23.354579 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a43b0abc-4117-41f7-9f51-9e58c0961f1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:23.355014 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a43b0abc-4117-41f7-9f51-9e58c0961f1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:23.355729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a43b0abc-4117-41f7-9f51-9e58c0961f1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:23.356184 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a43b0abc-4117-41f7-9f51-9e58c0961f1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:23.356607 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a43b0abc-4117-41f7-9f51-9e58c0961f1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:23.488314 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a43b0abc-4117-41f7-9f51-9e58c0961f1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:23.496515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a43b0abc-4117-41f7-9f51-9e58c0961f1f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.153610 Aug 29 19:12:23.497422 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 360/719] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:23 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:23.584413 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-700b59f2-5e1f-4c7a-851a-5ef2aa990f3a req-ec47c020-d2c1-47f8-88cc-b237cf38af56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddcbed3-129a-497b-aefb-a8a42ad2aec6", "name": "network-vif-plugged", "status": "completed", "tag": "547abed6-9c9a-44ab-8528-0a763a1230f2"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:23.596444 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-700b59f2-5e1f-4c7a-851a-5ef2aa990f3a req-ec47c020-d2c1-47f8-88cc-b237cf38af56 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:23.596933 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-700b59f2-5e1f-4c7a-851a-5ef2aa990f3a req-ec47c020-d2c1-47f8-88cc-b237cf38af56 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:23.597464 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-700b59f2-5e1f-4c7a-851a-5ef2aa990f3a req-ec47c020-d2c1-47f8-88cc-b237cf38af56 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:23.610573 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-700b59f2-5e1f-4c7a-851a-5ef2aa990f3a req-ec47c020-d2c1-47f8-88cc-b237cf38af56 service nova] Creating event network-vif-plugged:547abed6-9c9a-44ab-8528-0a763a1230f2 for instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 on hv-cinder-73126 Aug 29 19:12:23.615736 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-700b59f2-5e1f-4c7a-851a-5ef2aa990f3a req-ec47c020-d2c1-47f8-88cc-b237cf38af56 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035035 Aug 29 19:12:23.616602 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 360/720] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:23.806579 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d31833c1-9901-486f-b5be-eac5c261070d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:23.807875 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d31833c1-9901-486f-b5be-eac5c261070d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:23.813886 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d31833c1-9901-486f-b5be-eac5c261070d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:23.814381 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d31833c1-9901-486f-b5be-eac5c261070d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:23.814824 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d31833c1-9901-486f-b5be-eac5c261070d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:23.815560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d31833c1-9901-486f-b5be-eac5c261070d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:23.816077 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d31833c1-9901-486f-b5be-eac5c261070d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:23.816693 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d31833c1-9901-486f-b5be-eac5c261070d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:23.997921 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d31833c1-9901-486f-b5be-eac5c261070d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:24.005713 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d31833c1-9901-486f-b5be-eac5c261070d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1368 microversion: 2.1 time: 0.203742 Aug 29 19:12:24.006314 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 361/721] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:23 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:24.518449 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-886c72d4-ba75-4e9b-969a-989f8bfca42c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:24.519175 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-886c72d4-ba75-4e9b-969a-989f8bfca42c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:24.525844 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-886c72d4-ba75-4e9b-969a-989f8bfca42c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:24.526564 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-886c72d4-ba75-4e9b-969a-989f8bfca42c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:24.526773 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-886c72d4-ba75-4e9b-969a-989f8bfca42c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:24.527504 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-886c72d4-ba75-4e9b-969a-989f8bfca42c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:24.527962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-886c72d4-ba75-4e9b-969a-989f8bfca42c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:24.528388 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-886c72d4-ba75-4e9b-969a-989f8bfca42c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:24.659974 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-886c72d4-ba75-4e9b-969a-989f8bfca42c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:24.672029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-886c72d4-ba75-4e9b-969a-989f8bfca42c tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.156636 Aug 29 19:12:24.672617 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 361/722] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:24 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:25.028171 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6447bb18-2ba7-4938-8eb3-85c65cf39629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:25.028702 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6447bb18-2ba7-4938-8eb3-85c65cf39629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:25.035861 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6447bb18-2ba7-4938-8eb3-85c65cf39629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:25.036337 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6447bb18-2ba7-4938-8eb3-85c65cf39629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:25.036767 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6447bb18-2ba7-4938-8eb3-85c65cf39629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:25.037456 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6447bb18-2ba7-4938-8eb3-85c65cf39629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:25.037909 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6447bb18-2ba7-4938-8eb3-85c65cf39629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:25.038325 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6447bb18-2ba7-4938-8eb3-85c65cf39629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:25.171513 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6447bb18-2ba7-4938-8eb3-85c65cf39629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:25.179104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6447bb18-2ba7-4938-8eb3-85c65cf39629 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1368 microversion: 2.1 time: 0.155725 Aug 29 19:12:25.179666 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 362/723] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:25 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:25.694110 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ccffc21d-b585-4b95-bacc-150abb64cf22 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:25.694640 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ccffc21d-b585-4b95-bacc-150abb64cf22 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:25.701975 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ccffc21d-b585-4b95-bacc-150abb64cf22 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:25.702481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ccffc21d-b585-4b95-bacc-150abb64cf22 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:25.702900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ccffc21d-b585-4b95-bacc-150abb64cf22 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:25.703676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ccffc21d-b585-4b95-bacc-150abb64cf22 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:25.704135 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ccffc21d-b585-4b95-bacc-150abb64cf22 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:25.704560 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ccffc21d-b585-4b95-bacc-150abb64cf22 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:25.833041 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ccffc21d-b585-4b95-bacc-150abb64cf22 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:25.841966 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ccffc21d-b585-4b95-bacc-150abb64cf22 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.151772 Aug 29 19:12:25.842551 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 362/724] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:25 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:26.200253 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f3339f50-d714-4273-bb9f-bd2bfb3096f2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:26.200860 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f3339f50-d714-4273-bb9f-bd2bfb3096f2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:26.207164 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3339f50-d714-4273-bb9f-bd2bfb3096f2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:26.207661 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3339f50-d714-4273-bb9f-bd2bfb3096f2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:26.208075 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3339f50-d714-4273-bb9f-bd2bfb3096f2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:26.208761 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3339f50-d714-4273-bb9f-bd2bfb3096f2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:26.209207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3339f50-d714-4273-bb9f-bd2bfb3096f2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:26.209624 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f3339f50-d714-4273-bb9f-bd2bfb3096f2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:26.342970 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f3339f50-d714-4273-bb9f-bd2bfb3096f2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:26.350643 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f3339f50-d714-4273-bb9f-bd2bfb3096f2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1559 microversion: 2.1 time: 0.155179 Aug 29 19:12:26.351228 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 363/725] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:26 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:26.371277 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7e9d6464-5e2b-4699-88b2-4f5389991fa6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:26.371788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7e9d6464-5e2b-4699-88b2-4f5389991fa6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:26.378008 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e9d6464-5e2b-4699-88b2-4f5389991fa6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:26.378492 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e9d6464-5e2b-4699-88b2-4f5389991fa6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:26.378930 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e9d6464-5e2b-4699-88b2-4f5389991fa6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:26.379692 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e9d6464-5e2b-4699-88b2-4f5389991fa6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:26.380196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e9d6464-5e2b-4699-88b2-4f5389991fa6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:26.380673 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7e9d6464-5e2b-4699-88b2-4f5389991fa6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:26.463384 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7e9d6464-5e2b-4699-88b2-4f5389991fa6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096226 Aug 29 19:12:26.464921 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 363/726] 10.222.0.94 () {58 vars in 1275 bytes} [Mon Aug 29 19:12:26 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:26.870964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ef3a1baf-3152-4386-b9a8-92b0bf6ed660 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:26.871636 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ef3a1baf-3152-4386-b9a8-92b0bf6ed660 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:26.877793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3a1baf-3152-4386-b9a8-92b0bf6ed660 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:26.878288 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3a1baf-3152-4386-b9a8-92b0bf6ed660 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:26.878733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3a1baf-3152-4386-b9a8-92b0bf6ed660 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:26.879466 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3a1baf-3152-4386-b9a8-92b0bf6ed660 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:26.879927 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3a1baf-3152-4386-b9a8-92b0bf6ed660 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:26.880351 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3a1baf-3152-4386-b9a8-92b0bf6ed660 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:27.049336 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ef3a1baf-3152-4386-b9a8-92b0bf6ed660 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:27.058584 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ef3a1baf-3152-4386-b9a8-92b0bf6ed660 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.191846 Aug 29 19:12:27.059205 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 364/727] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:26 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:27.638584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-78a88dc6-ba1f-46f3-af63-e1a646b3449d req-c954860f-ef71-4a39-a007-e00b8b3ee333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ddcbed3-129a-497b-aefb-a8a42ad2aec6", "tag": "547abed6-9c9a-44ab-8528-0a763a1230f2"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:27.643499 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:27.649141 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-78a88dc6-ba1f-46f3-af63-e1a646b3449d req-c954860f-ef71-4a39-a007-e00b8b3ee333 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:27.649659 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-78a88dc6-ba1f-46f3-af63-e1a646b3449d req-c954860f-ef71-4a39-a007-e00b8b3ee333 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:27.650105 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-78a88dc6-ba1f-46f3-af63-e1a646b3449d req-c954860f-ef71-4a39-a007-e00b8b3ee333 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:27.663618 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-78a88dc6-ba1f-46f3-af63-e1a646b3449d req-c954860f-ef71-4a39-a007-e00b8b3ee333 service nova] Creating event network-changed:547abed6-9c9a-44ab-8528-0a763a1230f2 for instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 on hv-cinder-73126 Aug 29 19:12:27.669373 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-78a88dc6-ba1f-46f3-af63-e1a646b3449d req-c954860f-ef71-4a39-a007-e00b8b3ee333 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035434 Aug 29 19:12:27.670177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 364/728] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:28.088021 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e285ec36-d082-4514-a98d-4081151b8faa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:28.090112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e285ec36-d082-4514-a98d-4081151b8faa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:28.099058 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e285ec36-d082-4514-a98d-4081151b8faa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:28.100810 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e285ec36-d082-4514-a98d-4081151b8faa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:28.101510 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e285ec36-d082-4514-a98d-4081151b8faa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:28.102572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e285ec36-d082-4514-a98d-4081151b8faa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:28.103968 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e285ec36-d082-4514-a98d-4081151b8faa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:28.105260 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e285ec36-d082-4514-a98d-4081151b8faa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:28.331684 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e285ec36-d082-4514-a98d-4081151b8faa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:28.341805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e285ec36-d082-4514-a98d-4081151b8faa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.257806 Aug 29 19:12:28.342531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 365/729] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:28 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:29.364072 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-83d1bd1e-6244-49f3-930f-589ee580e55b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:29.364777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-83d1bd1e-6244-49f3-930f-589ee580e55b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:29.372436 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83d1bd1e-6244-49f3-930f-589ee580e55b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:29.373000 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83d1bd1e-6244-49f3-930f-589ee580e55b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:29.373446 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83d1bd1e-6244-49f3-930f-589ee580e55b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:29.374142 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83d1bd1e-6244-49f3-930f-589ee580e55b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:29.374602 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83d1bd1e-6244-49f3-930f-589ee580e55b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:29.375028 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83d1bd1e-6244-49f3-930f-589ee580e55b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:29.504488 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-83d1bd1e-6244-49f3-930f-589ee580e55b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:29.513448 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-83d1bd1e-6244-49f3-930f-589ee580e55b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.154288 Aug 29 19:12:29.514032 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 365/730] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:29 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:30.535729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a025e420-a95d-4d2d-be2e-b2a3fa01536a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:30.536272 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a025e420-a95d-4d2d-be2e-b2a3fa01536a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:30.543964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a025e420-a95d-4d2d-be2e-b2a3fa01536a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:30.544444 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a025e420-a95d-4d2d-be2e-b2a3fa01536a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:30.544873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a025e420-a95d-4d2d-be2e-b2a3fa01536a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:30.545553 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a025e420-a95d-4d2d-be2e-b2a3fa01536a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:30.546002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a025e420-a95d-4d2d-be2e-b2a3fa01536a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:30.546420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a025e420-a95d-4d2d-be2e-b2a3fa01536a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:30.677088 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a025e420-a95d-4d2d-be2e-b2a3fa01536a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:30.685948 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a025e420-a95d-4d2d-be2e-b2a3fa01536a tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.154109 Aug 29 19:12:30.686533 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 366/731] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:30 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:31.707195 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0cd5037f-ebb0-4449-8f0e-54c5e656f5fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:31.707842 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0cd5037f-ebb0-4449-8f0e-54c5e656f5fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:31.714255 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0cd5037f-ebb0-4449-8f0e-54c5e656f5fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:31.714794 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0cd5037f-ebb0-4449-8f0e-54c5e656f5fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:31.715366 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0cd5037f-ebb0-4449-8f0e-54c5e656f5fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:31.716069 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0cd5037f-ebb0-4449-8f0e-54c5e656f5fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:31.716534 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0cd5037f-ebb0-4449-8f0e-54c5e656f5fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:31.716968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0cd5037f-ebb0-4449-8f0e-54c5e656f5fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:31.847212 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0cd5037f-ebb0-4449-8f0e-54c5e656f5fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:31.855980 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0cd5037f-ebb0-4449-8f0e-54c5e656f5fa tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.152091 Aug 29 19:12:31.856961 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 366/732] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:31 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:32.877938 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fc9e6bc7-2d0f-46d1-b9ec-a57b16b9f4b9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:32.878534 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fc9e6bc7-2d0f-46d1-b9ec-a57b16b9f4b9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:32.885046 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9e6bc7-2d0f-46d1-b9ec-a57b16b9f4b9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:32.885526 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9e6bc7-2d0f-46d1-b9ec-a57b16b9f4b9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:32.885958 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9e6bc7-2d0f-46d1-b9ec-a57b16b9f4b9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:32.887252 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9e6bc7-2d0f-46d1-b9ec-a57b16b9f4b9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:32.887864 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9e6bc7-2d0f-46d1-b9ec-a57b16b9f4b9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:32.888172 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc9e6bc7-2d0f-46d1-b9ec-a57b16b9f4b9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:33.015350 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fc9e6bc7-2d0f-46d1-b9ec-a57b16b9f4b9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:33.023523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fc9e6bc7-2d0f-46d1-b9ec-a57b16b9f4b9 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.149452 Aug 29 19:12:33.024091 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 367/733] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:32 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:34.046110 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f843f5d6-4952-4570-8295-87088d093753 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:34.046669 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f843f5d6-4952-4570-8295-87088d093753 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:34.053266 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f843f5d6-4952-4570-8295-87088d093753 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:34.053844 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f843f5d6-4952-4570-8295-87088d093753 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:34.054302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f843f5d6-4952-4570-8295-87088d093753 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:34.055015 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f843f5d6-4952-4570-8295-87088d093753 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:34.055507 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f843f5d6-4952-4570-8295-87088d093753 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:34.055985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f843f5d6-4952-4570-8295-87088d093753 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:34.190693 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f843f5d6-4952-4570-8295-87088d093753 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:34.198956 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f843f5d6-4952-4570-8295-87088d093753 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.157445 Aug 29 19:12:34.200174 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 367/734] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:34 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:35.220974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-bde34403-c70a-4080-bc83-31b39fb1c670 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:35.221488 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-bde34403-c70a-4080-bc83-31b39fb1c670 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:35.223984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:35.229148 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bde34403-c70a-4080-bc83-31b39fb1c670 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:35.229631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bde34403-c70a-4080-bc83-31b39fb1c670 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:35.230064 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bde34403-c70a-4080-bc83-31b39fb1c670 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:35.231019 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bde34403-c70a-4080-bc83-31b39fb1c670 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:35.231506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bde34403-c70a-4080-bc83-31b39fb1c670 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:35.231934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bde34403-c70a-4080-bc83-31b39fb1c670 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:35.360969 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-bde34403-c70a-4080-bc83-31b39fb1c670 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:35.369138 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-bde34403-c70a-4080-bc83-31b39fb1c670 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.152111 Aug 29 19:12:35.369700 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 368/735] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:35 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:36.070718 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5571bfce-eee2-497c-90e1-0548401a8c52 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:36.071247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5571bfce-eee2-497c-90e1-0548401a8c52 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:36.078654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5571bfce-eee2-497c-90e1-0548401a8c52 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.079458 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5571bfce-eee2-497c-90e1-0548401a8c52 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.079702 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5571bfce-eee2-497c-90e1-0548401a8c52 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.080405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5571bfce-eee2-497c-90e1-0548401a8c52 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.080858 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5571bfce-eee2-497c-90e1-0548401a8c52 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.081305 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5571bfce-eee2-497c-90e1-0548401a8c52 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.111453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5571bfce-eee2-497c-90e1-0548401a8c52 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments/0abefbe3-beab-40ee-b35a-64fcab97b6e0" status: 200 len: 194 microversion: 2.20 time: 0.045493 Aug 29 19:12:36.111958 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 368/736] 10.222.0.94 () {60 vars in 1454 bytes} [Mon Aug 29 19:12:36 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments/0abefbe3-beab-40ee-b35a-64fcab97b6e0 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:12:36.178888 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2b9168c8-f362-45db-b82b-3a02ba58842a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:36.179418 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2b9168c8-f362-45db-b82b-3a02ba58842a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:36.186088 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2b9168c8-f362-45db-b82b-3a02ba58842a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.186573 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2b9168c8-f362-45db-b82b-3a02ba58842a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.187009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2b9168c8-f362-45db-b82b-3a02ba58842a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.187727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2b9168c8-f362-45db-b82b-3a02ba58842a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.188178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2b9168c8-f362-45db-b82b-3a02ba58842a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.188600 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2b9168c8-f362-45db-b82b-3a02ba58842a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.267901 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-2b9168c8-f362-45db-b82b-3a02ba58842a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lazy-loading 'services' on Instance uuid 4696f764-f3e7-482f-b94e-549896198ddf {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:36.340664 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2b9168c8-f362-45db-b82b-3a02ba58842a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments/0abefbe3-beab-40ee-b35a-64fcab97b6e0" status: 202 len: 0 microversion: 2.20 time: 0.165007 Aug 29 19:12:36.341249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 369/737] 10.222.0.94 () {60 vars in 1457 bytes} [Mon Aug 29 19:12:36 2022] DELETE /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments/0abefbe3-beab-40ee-b35a-64fcab97b6e0 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:12:36.350557 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fd3a8aa5-354c-44a0-8fda-a39bbf5d59da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:36.353148 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fd3a8aa5-354c-44a0-8fda-a39bbf5d59da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:36.359336 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd3a8aa5-354c-44a0-8fda-a39bbf5d59da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.359824 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd3a8aa5-354c-44a0-8fda-a39bbf5d59da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.360261 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd3a8aa5-354c-44a0-8fda-a39bbf5d59da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.360952 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd3a8aa5-354c-44a0-8fda-a39bbf5d59da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.361413 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd3a8aa5-354c-44a0-8fda-a39bbf5d59da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.361892 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fd3a8aa5-354c-44a0-8fda-a39bbf5d59da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.391032 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d78e6e03-946f-4d41-a3d8-947808285f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:36.391766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d78e6e03-946f-4d41-a3d8-947808285f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:36.392433 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fd3a8aa5-354c-44a0-8fda-a39bbf5d59da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046439 Aug 29 19:12:36.393013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 369/738] 10.222.0.94 () {60 vars in 1343 bytes} [Mon Aug 29 19:12:36 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:12:36.398452 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d78e6e03-946f-4d41-a3d8-947808285f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.398942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d78e6e03-946f-4d41-a3d8-947808285f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.399432 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d78e6e03-946f-4d41-a3d8-947808285f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.400163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d78e6e03-946f-4d41-a3d8-947808285f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:36.400669 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d78e6e03-946f-4d41-a3d8-947808285f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:36.401104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d78e6e03-946f-4d41-a3d8-947808285f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:36.539184 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d78e6e03-946f-4d41-a3d8-947808285f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:36.548787 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d78e6e03-946f-4d41-a3d8-947808285f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1735 microversion: 2.1 time: 0.162609 Aug 29 19:12:36.549360 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 370/739] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:36 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:37.405350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8214b3c5-2e71-4d6d-bce1-04d8d64ca1d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:37.407629 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8214b3c5-2e71-4d6d-bce1-04d8d64ca1d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:37.414432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8214b3c5-2e71-4d6d-bce1-04d8d64ca1d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.414923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8214b3c5-2e71-4d6d-bce1-04d8d64ca1d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.415643 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8214b3c5-2e71-4d6d-bce1-04d8d64ca1d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:37.416332 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8214b3c5-2e71-4d6d-bce1-04d8d64ca1d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.416784 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8214b3c5-2e71-4d6d-bce1-04d8d64ca1d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.417205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8214b3c5-2e71-4d6d-bce1-04d8d64ca1d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:37.448840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8214b3c5-2e71-4d6d-bce1-04d8d64ca1d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047734 Aug 29 19:12:37.449459 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 370/740] 10.222.0.94 () {60 vars in 1343 bytes} [Mon Aug 29 19:12:37 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:12:37.575586 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-85389721-63f1-4049-a52c-e3eb12695132 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:37.576791 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-85389721-63f1-4049-a52c-e3eb12695132 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:37.588895 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85389721-63f1-4049-a52c-e3eb12695132 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.589492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85389721-63f1-4049-a52c-e3eb12695132 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.590992 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85389721-63f1-4049-a52c-e3eb12695132 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:37.591763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85389721-63f1-4049-a52c-e3eb12695132 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.592228 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85389721-63f1-4049-a52c-e3eb12695132 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.592657 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-85389721-63f1-4049-a52c-e3eb12695132 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:37.724346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-85389721-63f1-4049-a52c-e3eb12695132 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:37.733562 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-85389721-63f1-4049-a52c-e3eb12695132 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1715 microversion: 2.1 time: 0.166703 Aug 29 19:12:37.734134 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 371/741] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:37 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1715 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:37.843815 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:37.844319 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:37.850346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.850835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.851309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:37.852053 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.852496 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.852923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:37.933861 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] HTTP exception thrown: Cannot 'detach_volume' instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa while it is in vm_state rescued Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Request method failure captured: Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: DELETE /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments/8ddf66ca-3b19-4b38-83a1-ec6ae7262f8c HTTP/1.1 Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6E5qq19XpHwlOHkTbjyma9QlFTrqFt7b9-twpMAOXdQdC0jV3pWUGE_MXRfTm_NQ3UnXuJjxiqQl_lHPtfUSarmRjbywIggIk9H_6vW-4_SeCMX7AMBMSIiCdM2J_TOMs4lmb3ACxn7AXkq0BEDSHTDmoEaY1zLgOYRdtjW6wZifc Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: b429eb37f4ed408d830ef2c1034e9bdc Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:12:37.935511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:12:37.937109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b429eb37f4ed408d830ef2c1034e9bdc"}]}] Aug 29 19:12:37.937109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:12:37.937109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: b429eb37f4ed408d830ef2c1034e9bdc Aug 29 19:12:37.937109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:12:37.937109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-ServerRescueNegativeTestJSON-1171381257-project Aug 29 19:12:37.937109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:12:37.937109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:12:37.937109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 73c4a7ab7fc7425389843798faa25372 Aug 29 19:12:37.937109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1171381257-project Aug 29 19:12:37.937109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:12:37.937109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Cannot 'detach_volume' instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa while it is in vm_state rescued Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'server_id': '0236f3d8-fe14-4ea6-a952-ad43a97260aa', 'id': '8ddf66ca-3b19-4b38-83a1-ec6ae7262f8c'} Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:12:37.937900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa while it is in vm_state rescued Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa while it is in vm_state rescued Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:12:37.939367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Returning 409 to user: Cannot 'detach_volume' instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa while it is in vm_state rescued {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:12:37.940569 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-dd0c5085-633c-4405-a1a8-55b18ae7464b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "DELETE /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments/8ddf66ca-3b19-4b38-83a1-ec6ae7262f8c" status: 409 len: 152 microversion: 2.1 time: 0.097965 Aug 29 19:12:37.940569 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 371/742] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:12:37 2022] DELETE /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments/8ddf66ca-3b19-4b38-83a1-ec6ae7262f8c => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 19:12:37.945755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fa1ebb01-0050-4063-9b69-c50b0bc19d01 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:37.946293 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fa1ebb01-0050-4063-9b69-c50b0bc19d01 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:37.952576 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fa1ebb01-0050-4063-9b69-c50b0bc19d01 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.953066 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fa1ebb01-0050-4063-9b69-c50b0bc19d01 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.953490 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fa1ebb01-0050-4063-9b69-c50b0bc19d01 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:37.954170 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fa1ebb01-0050-4063-9b69-c50b0bc19d01 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:37.954625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fa1ebb01-0050-4063-9b69-c50b0bc19d01 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:37.955048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fa1ebb01-0050-4063-9b69-c50b0bc19d01 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:37.994271 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:38.021542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fa1ebb01-0050-4063-9b69-c50b0bc19d01 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "POST /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/action" status: 202 len: 0 microversion: 2.1 time: 0.079319 Aug 29 19:12:38.022178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 372/743] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:12:37 2022] POST /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:12:38.031025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-93f28dec-ade3-4ced-af85-f06fb834c73f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:38.031752 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-93f28dec-ade3-4ced-af85-f06fb834c73f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:38.037807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93f28dec-ade3-4ced-af85-f06fb834c73f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:38.038296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93f28dec-ade3-4ced-af85-f06fb834c73f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:38.038731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93f28dec-ade3-4ced-af85-f06fb834c73f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:38.039451 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93f28dec-ade3-4ced-af85-f06fb834c73f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:38.039911 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93f28dec-ade3-4ced-af85-f06fb834c73f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:38.040635 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93f28dec-ade3-4ced-af85-f06fb834c73f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:38.176306 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-93f28dec-ade3-4ced-af85-f06fb834c73f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:38.184967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-93f28dec-ade3-4ced-af85-f06fb834c73f tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1723 microversion: 2.1 time: 0.158306 Aug 29 19:12:38.185536 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 372/744] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:38 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:38.466668 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-81e28192-1fa5-49b2-a8ba-d979220a697b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:38.469003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-81e28192-1fa5-49b2-a8ba-d979220a697b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:38.474977 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-81e28192-1fa5-49b2-a8ba-d979220a697b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:38.475486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-81e28192-1fa5-49b2-a8ba-d979220a697b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:38.475914 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-81e28192-1fa5-49b2-a8ba-d979220a697b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:38.476603 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-81e28192-1fa5-49b2-a8ba-d979220a697b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:38.477049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-81e28192-1fa5-49b2-a8ba-d979220a697b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:38.477462 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-81e28192-1fa5-49b2-a8ba-d979220a697b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:38.510599 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-81e28192-1fa5-49b2-a8ba-d979220a697b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051715 Aug 29 19:12:38.511192 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 373/745] 10.222.0.94 () {60 vars in 1343 bytes} [Mon Aug 29 19:12:38 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:12:39.205873 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fe46e74c-da96-499b-9d56-0ddce57a0c60 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:39.206483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fe46e74c-da96-499b-9d56-0ddce57a0c60 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:39.212806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe46e74c-da96-499b-9d56-0ddce57a0c60 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.213289 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe46e74c-da96-499b-9d56-0ddce57a0c60 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.213727 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe46e74c-da96-499b-9d56-0ddce57a0c60 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.214415 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe46e74c-da96-499b-9d56-0ddce57a0c60 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.214917 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe46e74c-da96-499b-9d56-0ddce57a0c60 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.215569 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fe46e74c-da96-499b-9d56-0ddce57a0c60 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.343290 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fe46e74c-da96-499b-9d56-0ddce57a0c60 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:39.351455 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fe46e74c-da96-499b-9d56-0ddce57a0c60 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1723 microversion: 2.1 time: 0.149483 Aug 29 19:12:39.352020 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 373/746] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:39 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:39.523589 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a847a7ea-4b9c-4b4d-a761-d72959a3035f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:39.525739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a847a7ea-4b9c-4b4d-a761-d72959a3035f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:39.533591 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a847a7ea-4b9c-4b4d-a761-d72959a3035f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.534098 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a847a7ea-4b9c-4b4d-a761-d72959a3035f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.534531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a847a7ea-4b9c-4b4d-a761-d72959a3035f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.535256 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a847a7ea-4b9c-4b4d-a761-d72959a3035f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.535707 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a847a7ea-4b9c-4b4d-a761-d72959a3035f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.536127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a847a7ea-4b9c-4b4d-a761-d72959a3035f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.570697 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a847a7ea-4b9c-4b4d-a761-d72959a3035f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050972 Aug 29 19:12:39.571297 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 374/747] 10.222.0.94 () {60 vars in 1343 bytes} [Mon Aug 29 19:12:39 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:39.635798 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-71eb3237-5702-470c-a393-f9bf4b3916f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:39.636300 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-71eb3237-5702-470c-a393-f9bf4b3916f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:39.643169 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71eb3237-5702-470c-a393-f9bf4b3916f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.643692 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71eb3237-5702-470c-a393-f9bf4b3916f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.644123 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71eb3237-5702-470c-a393-f9bf4b3916f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.644881 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71eb3237-5702-470c-a393-f9bf4b3916f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.645341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71eb3237-5702-470c-a393-f9bf4b3916f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.645763 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-71eb3237-5702-470c-a393-f9bf4b3916f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.673565 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-71eb3237-5702-470c-a393-f9bf4b3916f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:12:39.749178 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-71eb3237-5702-470c-a393-f9bf4b3916f6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 204 len: 0 microversion: 2.20 time: 0.117215 Aug 29 19:12:39.750472 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 374/748] 10.222.0.94 () {60 vars in 1280 bytes} [Mon Aug 29 19:12:39 2022] DELETE /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 19:12:39.758949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:39.759619 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:39.766431 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.766924 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.767395 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.768096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:39.768584 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:39.769127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:39.907803 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:39.917337 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:39.919051 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:39.920359 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ce79a3e2-9379-4805-a79f-11264f794221 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.165474 Aug 29 19:12:39.920943 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 375/749] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:39 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:12:40.373783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d10800b3-474c-4f27-a26a-587cfe67c48e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:40.374467 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d10800b3-474c-4f27-a26a-587cfe67c48e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:40.380787 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d10800b3-474c-4f27-a26a-587cfe67c48e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:40.381261 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d10800b3-474c-4f27-a26a-587cfe67c48e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:40.381691 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d10800b3-474c-4f27-a26a-587cfe67c48e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:40.382371 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d10800b3-474c-4f27-a26a-587cfe67c48e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:40.382824 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d10800b3-474c-4f27-a26a-587cfe67c48e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:40.383273 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d10800b3-474c-4f27-a26a-587cfe67c48e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:40.401664 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:12:40.520805 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d10800b3-474c-4f27-a26a-587cfe67c48e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:40.529455 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d10800b3-474c-4f27-a26a-587cfe67c48e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1723 microversion: 2.1 time: 0.160448 Aug 29 19:12:40.530026 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 375/750] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:40 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:40.944550 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:40.945086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:40.952593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:40.953097 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:40.953539 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:40.954240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:40.954709 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:40.955170 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:41.100118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:41.108300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:41.109749 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:41.110912 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3722e22c-7414-4ca9-946c-e3b9817ee20d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.170642 Aug 29 19:12:41.111535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 376/751] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:40 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:41.551541 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-29ccb0b3-6d3f-4d71-8d2b-103e7b7313b6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:41.552185 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-29ccb0b3-6d3f-4d71-8d2b-103e7b7313b6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:41.558640 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-29ccb0b3-6d3f-4d71-8d2b-103e7b7313b6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:41.559171 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-29ccb0b3-6d3f-4d71-8d2b-103e7b7313b6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:41.559679 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-29ccb0b3-6d3f-4d71-8d2b-103e7b7313b6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:41.560408 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-29ccb0b3-6d3f-4d71-8d2b-103e7b7313b6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:41.560866 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-29ccb0b3-6d3f-4d71-8d2b-103e7b7313b6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:41.561291 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-29ccb0b3-6d3f-4d71-8d2b-103e7b7313b6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:41.691558 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-29ccb0b3-6d3f-4d71-8d2b-103e7b7313b6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:41.699983 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-29ccb0b3-6d3f-4d71-8d2b-103e7b7313b6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1723 microversion: 2.1 time: 0.152055 Aug 29 19:12:41.700554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 376/752] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:41 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:42.133971 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:42.134567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:42.141726 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:42.142246 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:42.142688 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:42.143416 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:42.143875 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:42.144303 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:42.303007 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:42.320671 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:42.322171 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:42.323321 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-852b82f0-03d6-4793-87d9-d6aa62d0bbcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.193276 Aug 29 19:12:42.325222 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 377/753] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:42 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:42.720839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ce473a04-f7f4-4bcb-9e97-5b594fb8a15d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:42.721463 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ce473a04-f7f4-4bcb-9e97-5b594fb8a15d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:42.728246 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ce473a04-f7f4-4bcb-9e97-5b594fb8a15d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:42.728763 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ce473a04-f7f4-4bcb-9e97-5b594fb8a15d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:42.729209 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ce473a04-f7f4-4bcb-9e97-5b594fb8a15d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:42.729911 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ce473a04-f7f4-4bcb-9e97-5b594fb8a15d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:42.730871 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ce473a04-f7f4-4bcb-9e97-5b594fb8a15d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:42.731323 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ce473a04-f7f4-4bcb-9e97-5b594fb8a15d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:42.898855 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ce473a04-f7f4-4bcb-9e97-5b594fb8a15d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:42.909842 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ce473a04-f7f4-4bcb-9e97-5b594fb8a15d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1723 microversion: 2.1 time: 0.192832 Aug 29 19:12:42.910697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 377/754] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:42 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:12:43.347488 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:43.348094 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:43.354654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:43.355165 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:43.356197 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:43.356892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:43.357377 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:43.357938 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:43.493701 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:43.502992 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:43.504748 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:43.506091 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-78455e1c-2973-4799-9935-f73f10c4df76 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1722 microversion: 2.20 time: 0.162653 Aug 29 19:12:43.506906 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 378/755] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:43 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:43.933687 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fa778b7d-4a90-4386-aad8-c5210ea7c3a1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:43.934854 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fa778b7d-4a90-4386-aad8-c5210ea7c3a1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:43.941483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa778b7d-4a90-4386-aad8-c5210ea7c3a1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:43.942021 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa778b7d-4a90-4386-aad8-c5210ea7c3a1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:43.942509 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa778b7d-4a90-4386-aad8-c5210ea7c3a1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:43.943401 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa778b7d-4a90-4386-aad8-c5210ea7c3a1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:43.943914 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa778b7d-4a90-4386-aad8-c5210ea7c3a1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:43.944495 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa778b7d-4a90-4386-aad8-c5210ea7c3a1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:44.186245 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fa778b7d-4a90-4386-aad8-c5210ea7c3a1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:44.194351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fa778b7d-4a90-4386-aad8-c5210ea7c3a1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1729 microversion: 2.1 time: 0.264534 Aug 29 19:12:44.194919 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 378/756] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:43 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1729 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:44.215389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-54b0bea4-8c18-41e9-8110-e17026e68f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:44.215873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-54b0bea4-8c18-41e9-8110-e17026e68f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:44.222686 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-54b0bea4-8c18-41e9-8110-e17026e68f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:44.223203 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-54b0bea4-8c18-41e9-8110-e17026e68f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:44.223646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-54b0bea4-8c18-41e9-8110-e17026e68f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:44.224349 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-54b0bea4-8c18-41e9-8110-e17026e68f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:44.224808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-54b0bea4-8c18-41e9-8110-e17026e68f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:44.225233 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-54b0bea4-8c18-41e9-8110-e17026e68f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:44.347420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-54b0bea4-8c18-41e9-8110-e17026e68f93 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136118 Aug 29 19:12:44.348263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 379/757] 10.222.0.94 () {58 vars in 1275 bytes} [Mon Aug 29 19:12:44 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:44.530266 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:44.530536 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:44.536962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:44.537453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:44.537881 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:44.538577 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:44.539021 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:44.539484 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:44.618825 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:44.628212 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:44.629763 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:44.630934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-44918ba2-2840-49a6-adaa-585723e97692 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1654 microversion: 2.20 time: 0.105034 Aug 29 19:12:44.631693 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 379/758] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:44 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1654 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:44.818507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-e126d3ee-38de-4bb4-8e43-387481b7ac7f req-d493f356-36df-4aeb-9829-0df380371e0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4696f764-f3e7-482f-b94e-549896198ddf", "name": "network-vif-deleted", "tag": "90bec49f-36b1-4027-8fc3-86cd4d15e3f4"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:44.831692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-e126d3ee-38de-4bb4-8e43-387481b7ac7f req-d493f356-36df-4aeb-9829-0df380371e0b service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:44.833100 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-e126d3ee-38de-4bb4-8e43-387481b7ac7f req-d493f356-36df-4aeb-9829-0df380371e0b service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:44.833703 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-e126d3ee-38de-4bb4-8e43-387481b7ac7f req-d493f356-36df-4aeb-9829-0df380371e0b service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:44.856874 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-e126d3ee-38de-4bb4-8e43-387481b7ac7f req-d493f356-36df-4aeb-9829-0df380371e0b service nova] Creating event network-vif-deleted:90bec49f-36b1-4027-8fc3-86cd4d15e3f4 for instance 4696f764-f3e7-482f-b94e-549896198ddf on hv-cinder-73126 Aug 29 19:12:44.862209 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-e126d3ee-38de-4bb4-8e43-387481b7ac7f req-d493f356-36df-4aeb-9829-0df380371e0b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047801 Aug 29 19:12:44.863044 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 380/759] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:45.363697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-1d074ba5-06ca-4f05-9223-c12e3269260a req-de65f12f-288a-48c9-983d-604182e77136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0236f3d8-fe14-4ea6-a952-ad43a97260aa", "tag": "f5ea5791-6357-48d5-bdaa-4b91eacc1a22"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:45.374620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-1d074ba5-06ca-4f05-9223-c12e3269260a req-de65f12f-288a-48c9-983d-604182e77136 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:45.375540 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-1d074ba5-06ca-4f05-9223-c12e3269260a req-de65f12f-288a-48c9-983d-604182e77136 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:45.376206 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-1d074ba5-06ca-4f05-9223-c12e3269260a req-de65f12f-288a-48c9-983d-604182e77136 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:45.389167 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-1d074ba5-06ca-4f05-9223-c12e3269260a req-de65f12f-288a-48c9-983d-604182e77136 service nova] Creating event network-changed:f5ea5791-6357-48d5-bdaa-4b91eacc1a22 for instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa on hv-cinder-73126 Aug 29 19:12:45.395915 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-1d074ba5-06ca-4f05-9223-c12e3269260a req-de65f12f-288a-48c9-983d-604182e77136 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035593 Aug 29 19:12:45.396843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 380/760] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:45.656452 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:45.662335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:45.667396 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:45.668622 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:45.669321 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:45.670409 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:45.671255 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:45.671867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:45.707827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:45.708462 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:45.709084 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:45.709755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lazy-loading 'fault' on Instance uuid 4696f764-f3e7-482f-b94e-549896198ddf {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:45.756495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:45.766951 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:45.768774 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:45.770127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6afb6bb9-3d33-4120-b4e1-7377c4d1dc86 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1370 microversion: 2.20 time: 0.119212 Aug 29 19:12:45.770723 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 381/761] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:45 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1370 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:46.795303 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:46.795999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:46.802268 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:46.802755 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:46.803224 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:46.803923 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:46.804380 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:46.804810 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:46.836210 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:46.836690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:46.837124 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:46.837936 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lazy-loading 'fault' on Instance uuid 4696f764-f3e7-482f-b94e-549896198ddf {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:46.879163 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:46.887887 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:46.889340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:46.890480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a22d3d1b-f04e-4086-b12b-5f9f18952f20 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1370 microversion: 2.20 time: 0.100317 Aug 29 19:12:46.891030 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 381/762] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:46 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:47.414559 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-05491221-8a2f-49e4-bd2b-e0444e23f4af req-8145fe04-a884-4036-b44f-567bf2c0cf98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0236f3d8-fe14-4ea6-a952-ad43a97260aa", "tag": "f5ea5791-6357-48d5-bdaa-4b91eacc1a22"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:47.425181 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-05491221-8a2f-49e4-bd2b-e0444e23f4af req-8145fe04-a884-4036-b44f-567bf2c0cf98 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:47.425659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-05491221-8a2f-49e4-bd2b-e0444e23f4af req-8145fe04-a884-4036-b44f-567bf2c0cf98 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:47.426089 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-05491221-8a2f-49e4-bd2b-e0444e23f4af req-8145fe04-a884-4036-b44f-567bf2c0cf98 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:47.437637 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-05491221-8a2f-49e4-bd2b-e0444e23f4af req-8145fe04-a884-4036-b44f-567bf2c0cf98 service nova] Creating event network-changed:f5ea5791-6357-48d5-bdaa-4b91eacc1a22 for instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa on hv-cinder-73126 Aug 29 19:12:47.442543 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-05491221-8a2f-49e4-bd2b-e0444e23f4af req-8145fe04-a884-4036-b44f-567bf2c0cf98 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031711 Aug 29 19:12:47.443180 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 382/763] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:12:47.914071 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:47.914664 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:47.921429 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:47.921913 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:47.922351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:47.923042 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:47.923521 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:47.923951 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:47.956531 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:47.957015 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:47.957448 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:47.957894 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lazy-loading 'fault' on Instance uuid 4696f764-f3e7-482f-b94e-549896198ddf {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:12:47.997824 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:48.005796 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:48.007272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:48.008422 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d708744a-479d-4ce8-94dc-26c386ef33fc tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 200 len: 1370 microversion: 2.20 time: 0.098232 Aug 29 19:12:48.008977 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 382/764] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:47 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 1370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:49.033124 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:49.033811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:49.040804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:49.041495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:49.041931 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:49.042620 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:49.043729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:49.044161 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:49.057703 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] HTTP exception thrown: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Request method failure captured: Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf HTTP/1.1 Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6IiQyLUCVrGx4FNobzqN9jPn1pjyNWyk43mZUIle2YJWfP94UoSI5fkezwOGT8wD7ta-5z2vbVah8-uAxtqybkqlOPGS1I2xPIdFFXIEK0KRHK8PBX3ZsAOQWjhP--KJQWxWhSvtqRmWJ2SakZ-QNyVe9UfKCBdcf1lXvCtvItnrk Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:12:49.059756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}] Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ff8ce50a95b742a48500e634db50fb36 Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:12:49.061435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '4696f764-f3e7-482f-b94e-549896198ddf'} Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:12:49.062615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:12:49.064086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:12:49.065452 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Returning 404 to user: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:12:49.065452 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a374d837-5c33-4eb9-a344-a78c19de4461 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 404 len: 111 microversion: 2.20 time: 0.032048 Aug 29 19:12:49.065452 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 383/765] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:49 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:12:49.072151 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2d267831-6c20-443d-9139-3b04aea08bcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '.version_select at 0x7f3d762b2dc0>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:49.091906 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2d267831-6c20-443d-9139-3b04aea08bcd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-457457575" status: 204 len: 0 microversion: 2.20 time: 0.024391 Aug 29 19:12:49.092753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 383/766] 10.222.0.94 () {60 vars in 1259 bytes} [Mon Aug 29 19:12:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-457457575 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 19:12:49.977217 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f119959d-3ffc-40a5-864f-ce1ff2956cba tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Action: 'create', calling method: .version_select at 0x7f3d76200670>, body: {"keypair": {"name": "tempest-keypair-1348536362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD7/ln/KCO16TqKONGo4myyVsRFei9HtV6Ik0e17p7B4B/Qkiohn1PgQGkPEA2bxLcHQDrIHo+66BRuBAvDlNxDedxmMC8iAqn3OGJye0A2N8J0gIJ3gdLtQhu6yNXMMUg=="}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:49.993464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-f119959d-3ffc-40a5-864f-ce1ff2956cba tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Getting quotas for project 6f6085f7a1df49ae8e2375e28d7d6792. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:12:49.997569 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-f119959d-3ffc-40a5-864f-ce1ff2956cba tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Getting quotas for user ff8ce50a95b742a48500e634db50fb36 and project 6f6085f7a1df49ae8e2375e28d7d6792. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:12:50.019234 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f119959d-3ffc-40a5-864f-ce1ff2956cba tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.045912 Aug 29 19:12:50.019833 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 384/767] 10.222.0.94 () {62 vars in 1200 bytes} [Mon Aug 29 19:12:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 19:12:51.210122 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2061719317", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4625722-be90-4944-a2a2-5603ab9cea5a"}], "security_groups": [{"name": "tempest-securitygroup--1122018872"}], "key_name": "tempest-keypair-1348536362", "user_data": "}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:51.476018 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] validate_networks() for [('b4625722-be90-4944-a2a2-5603ab9cea5a', None, None, None, None, None)] {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:12:51.847770 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:12:51.848194 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:12:51.848695 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:12:51.849709 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:12:51.850905 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:12:51.861264 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:51.861745 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:51.862175 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:51.862895 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:51.863370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:51.863788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:51.881620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Getting quotas for project 6f6085f7a1df49ae8e2375e28d7d6792. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:12:51.885563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Getting quotas for user ff8ce50a95b742a48500e634db50fb36 and project 6f6085f7a1df49ae8e2375e28d7d6792. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:12:51.897618 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:12:51.899966 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:12:51.949548 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-82cab9a4-0010-4109-98c3-206668812d72 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.743701 Aug 29 19:12:51.950523 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 384/768] 10.222.0.94 () {62 vars in 1188 bytes} [Mon Aug 29 19:12:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 745 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 19:12:51.964449 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-18ad130f-7628-4533-ae8f-84aa42c21243 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:51.965429 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-18ad130f-7628-4533-ae8f-84aa42c21243 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:52.026979 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-18ad130f-7628-4533-ae8f-84aa42c21243 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:52.036069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-18ad130f-7628-4533-ae8f-84aa42c21243 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:52.037782 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-18ad130f-7628-4533-ae8f-84aa42c21243 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:52.039191 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-18ad130f-7628-4533-ae8f-84aa42c21243 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1282 microversion: 2.20 time: 0.081390 Aug 29 19:12:52.040089 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 385/769] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:51 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:53.284209 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:53.284830 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:53.291759 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:53.292246 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:53.292681 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:53.293887 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:53.294349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:53.295121 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:53.378910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:53.388152 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:53.389608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:53.390758 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b55dbfbc-192c-4ec7-825b-7336aff09e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1342 microversion: 2.20 time: 0.332270 Aug 29 19:12:53.391345 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 385/770] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:53 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1342 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:54.414082 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:54.414693 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:54.421051 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:54.421539 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:54.421971 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:54.422667 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:54.423150 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:54.423576 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:54.594255 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-b957aca4-c70a-4768-943b-3ce6bfe9e4b4 req-e35db562-a956-4828-b2c5-24dbf41cde73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9713d174-1918-4168-b6e7-bf1359b50155", "tag": "d4371ad0-840e-40ed-b29d-5fdc435f7837"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:54.605373 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-b957aca4-c70a-4768-943b-3ce6bfe9e4b4 req-e35db562-a956-4828-b2c5-24dbf41cde73 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:54.606132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-b957aca4-c70a-4768-943b-3ce6bfe9e4b4 req-e35db562-a956-4828-b2c5-24dbf41cde73 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:54.606853 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-b957aca4-c70a-4768-943b-3ce6bfe9e4b4 req-e35db562-a956-4828-b2c5-24dbf41cde73 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:54.621087 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-b957aca4-c70a-4768-943b-3ce6bfe9e4b4 req-e35db562-a956-4828-b2c5-24dbf41cde73 service nova] Creating event network-changed:d4371ad0-840e-40ed-b29d-5fdc435f7837 for instance 9713d174-1918-4168-b6e7-bf1359b50155 on hv-cinder-73126 Aug 29 19:12:54.628155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-b957aca4-c70a-4768-943b-3ce6bfe9e4b4 req-e35db562-a956-4828-b2c5-24dbf41cde73 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038061 Aug 29 19:12:54.628802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 386/771] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:12:54.799448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:54.808634 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:54.811126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:54.812410 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-bd5381a6-e532-4123-80a6-e4d2f1b3a224 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1408 microversion: 2.20 time: 0.403087 Aug 29 19:12:54.813042 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 386/772] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:54 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1408 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:55.836490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:55.837186 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:55.845050 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:55.845532 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:55.845967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:55.846653 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:55.847133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:55.847647 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:55.979483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:55.988238 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:55.989669 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:55.990760 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c9bdec46-c634-491e-9071-723e96967a19 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1408 microversion: 2.20 time: 0.158539 Aug 29 19:12:55.991343 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 387/773] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:55 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:56.425042 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-705628b1-2ee3-4d77-9be2-8b40559f0671 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:56.427333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-705628b1-2ee3-4d77-9be2-8b40559f0671 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:56.434015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-705628b1-2ee3-4d77-9be2-8b40559f0671 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:56.434596 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-705628b1-2ee3-4d77-9be2-8b40559f0671 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:56.435541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-705628b1-2ee3-4d77-9be2-8b40559f0671 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:56.435904 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-705628b1-2ee3-4d77-9be2-8b40559f0671 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:56.436352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-705628b1-2ee3-4d77-9be2-8b40559f0671 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:56.436773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-705628b1-2ee3-4d77-9be2-8b40559f0671 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:56.473610 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-705628b1-2ee3-4d77-9be2-8b40559f0671 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052636 Aug 29 19:12:56.474274 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 387/774] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:12:56 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 19:12:56.540088 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-223b89ac-bf1c-4a20-b158-579fdbbd60df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:56.540582 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-223b89ac-bf1c-4a20-b158-579fdbbd60df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:56.547840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223b89ac-bf1c-4a20-b158-579fdbbd60df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:56.548325 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223b89ac-bf1c-4a20-b158-579fdbbd60df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:56.548759 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223b89ac-bf1c-4a20-b158-579fdbbd60df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:56.549480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223b89ac-bf1c-4a20-b158-579fdbbd60df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:56.549928 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223b89ac-bf1c-4a20-b158-579fdbbd60df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:56.550345 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-223b89ac-bf1c-4a20-b158-579fdbbd60df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:56.578854 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-223b89ac-bf1c-4a20-b158-579fdbbd60df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:12:56.665330 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-223b89ac-bf1c-4a20-b158-579fdbbd60df tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "DELETE /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 204 len: 0 microversion: 2.1 time: 0.128732 Aug 29 19:12:56.666463 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 388/775] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:12:56 2022] DELETE /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:12:56.675034 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-4cacb02d-adec-494b-a4d9-1d20c3eb875a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:56.675785 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-4cacb02d-adec-494b-a4d9-1d20c3eb875a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:56.678404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:12:56.678548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Mon Aug 29 19:12:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 (ip 10.222.0.94) !!! Aug 29 19:12:56.690971 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4cacb02d-adec-494b-a4d9-1d20c3eb875a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:56.691486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4cacb02d-adec-494b-a4d9-1d20c3eb875a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:56.691920 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4cacb02d-adec-494b-a4d9-1d20c3eb875a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:56.692730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4cacb02d-adec-494b-a4d9-1d20c3eb875a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:56.693189 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4cacb02d-adec-494b-a4d9-1d20c3eb875a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:56.693607 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4cacb02d-adec-494b-a4d9-1d20c3eb875a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:56.897775 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4cacb02d-adec-494b-a4d9-1d20c3eb875a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:56.906275 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-4cacb02d-adec-494b-a4d9-1d20c3eb875a tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1675 microversion: 2.1 time: 0.235078 Aug 29 19:12:56.906839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 388/776] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:56 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1675 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:57.014633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:57.015279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:57.021822 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.022334 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.022807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:57.023596 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.024083 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.024543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:57.154236 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:57.162403 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:57.163869 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:57.164964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0a7509eb-79c1-4379-bcff-f02b0370f3b6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1408 microversion: 2.20 time: 0.155437 Aug 29 19:12:57.165527 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 389/777] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:57 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:57.928006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-50419f08-b6c7-4f6b-b4b5-6353a10a3914 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:57.928713 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-50419f08-b6c7-4f6b-b4b5-6353a10a3914 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:57.936827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50419f08-b6c7-4f6b-b4b5-6353a10a3914 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.937334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50419f08-b6c7-4f6b-b4b5-6353a10a3914 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.937814 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50419f08-b6c7-4f6b-b4b5-6353a10a3914 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:57.938567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50419f08-b6c7-4f6b-b4b5-6353a10a3914 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:57.939054 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50419f08-b6c7-4f6b-b4b5-6353a10a3914 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:57.939550 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50419f08-b6c7-4f6b-b4b5-6353a10a3914 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:58.073564 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-50419f08-b6c7-4f6b-b4b5-6353a10a3914 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:58.081421 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-50419f08-b6c7-4f6b-b4b5-6353a10a3914 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1675 microversion: 2.1 time: 0.157527 Aug 29 19:12:58.081982 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 389/778] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:57 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:58.189041 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:58.189611 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:58.195512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:58.196000 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:58.196443 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:58.197159 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:58.197632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:58.198047 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:58.329490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:58.337499 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:58.338954 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:58.340609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-86ee89b3-151f-4855-82d0-26ecb41eef91 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1408 microversion: 2.20 time: 0.156236 Aug 29 19:12:58.341193 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 390/779] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:58 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:59.102891 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5296d72b-5b8a-4748-ab77-e81dc9e30d7f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:59.103514 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5296d72b-5b8a-4748-ab77-e81dc9e30d7f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:59.110454 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5296d72b-5b8a-4748-ab77-e81dc9e30d7f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:59.110929 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5296d72b-5b8a-4748-ab77-e81dc9e30d7f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:59.111394 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5296d72b-5b8a-4748-ab77-e81dc9e30d7f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:59.112070 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5296d72b-5b8a-4748-ab77-e81dc9e30d7f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:59.112518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5296d72b-5b8a-4748-ab77-e81dc9e30d7f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:59.112934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5296d72b-5b8a-4748-ab77-e81dc9e30d7f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:59.335269 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5296d72b-5b8a-4748-ab77-e81dc9e30d7f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:59.343921 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5296d72b-5b8a-4748-ab77-e81dc9e30d7f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1675 microversion: 2.1 time: 0.244909 Aug 29 19:12:59.344508 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 390/780] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:12:59 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:12:59.363440 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:12:59.363981 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:12:59.370304 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:59.370791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:59.371266 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:59.372138 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:59.372596 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:59.373020 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:59.607126 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:59.615446 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:59.616824 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:12:59.617927 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8a397faf-2bd6-4858-b1bd-af50b3fa186a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1408 microversion: 2.20 time: 0.258422 Aug 29 19:12:59.618489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 391/781] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:12:59 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:12:59.908673 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-49135081-51b3-4bc4-8c61-75eddbfc1aa1 req-80e265b6-f79a-4b1e-813e-e35caa4cdd04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9713d174-1918-4168-b6e7-bf1359b50155", "name": "network-vif-plugged", "status": "completed", "tag": "d4371ad0-840e-40ed-b29d-5fdc435f7837"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:12:59.920096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-49135081-51b3-4bc4-8c61-75eddbfc1aa1 req-80e265b6-f79a-4b1e-813e-e35caa4cdd04 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:12:59.920801 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-49135081-51b3-4bc4-8c61-75eddbfc1aa1 req-80e265b6-f79a-4b1e-813e-e35caa4cdd04 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:12:59.921296 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-49135081-51b3-4bc4-8c61-75eddbfc1aa1 req-80e265b6-f79a-4b1e-813e-e35caa4cdd04 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:12:59.932805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-49135081-51b3-4bc4-8c61-75eddbfc1aa1 req-80e265b6-f79a-4b1e-813e-e35caa4cdd04 service nova] Creating event network-vif-plugged:d4371ad0-840e-40ed-b29d-5fdc435f7837 for instance 9713d174-1918-4168-b6e7-bf1359b50155 on hv-cinder-73126 Aug 29 19:12:59.938630 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-49135081-51b3-4bc4-8c61-75eddbfc1aa1 req-80e265b6-f79a-4b1e-813e-e35caa4cdd04 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033579 Aug 29 19:12:59.939509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 391/782] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:00.155558 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-b58f4398-e9b7-4f4c-bbde-dfd981a9d745 req-ddb3e8ba-4d19-4b59-9e05-f0879624b674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22f96567-e842-4352-9e40-e31d2f547937", "name": "network-vif-deleted", "tag": "2d38d71d-cc1e-42fd-b291-eb339787cf57"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:00.161167 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:00.175650 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-b58f4398-e9b7-4f4c-bbde-dfd981a9d745 req-ddb3e8ba-4d19-4b59-9e05-f0879624b674 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:00.176466 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-b58f4398-e9b7-4f4c-bbde-dfd981a9d745 req-ddb3e8ba-4d19-4b59-9e05-f0879624b674 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:00.177093 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-b58f4398-e9b7-4f4c-bbde-dfd981a9d745 req-ddb3e8ba-4d19-4b59-9e05-f0879624b674 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:00.195128 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-b58f4398-e9b7-4f4c-bbde-dfd981a9d745 req-ddb3e8ba-4d19-4b59-9e05-f0879624b674 service nova] Creating event network-vif-deleted:2d38d71d-cc1e-42fd-b291-eb339787cf57 for instance 22f96567-e842-4352-9e40-e31d2f547937 on hv-cinder-73126 Aug 29 19:13:00.206557 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-b58f4398-e9b7-4f4c-bbde-dfd981a9d745 req-ddb3e8ba-4d19-4b59-9e05-f0879624b674 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055632 Aug 29 19:13:00.207816 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 392/783] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:00.366769 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:00.367534 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:00.374819 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:00.375450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:00.375941 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:00.376695 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:00.377194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:00.377625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:00.410153 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:00.410600 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:00.411039 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:00.411540 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lazy-loading 'fault' on Instance uuid 22f96567-e842-4352-9e40-e31d2f547937 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:13:00.456444 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:00.464432 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5aed3aeb-b27c-415b-84b8-20bf242307c0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1328 microversion: 2.1 time: 0.102895 Aug 29 19:13:00.465042 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 392/784] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:00 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:00.643693 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:00.644585 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:00.650980 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:00.651506 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:00.651941 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:00.652643 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:00.653283 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:00.653715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:00.673637 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:00.797802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:00.806604 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:00.807920 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:00.809715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1e426383-f590-4829-8db4-9f86163e8527 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1408 microversion: 2.20 time: 0.170216 Aug 29 19:13:00.810492 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 393/785] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:13:00 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:13:01.486533 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:01.487219 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:01.495436 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:01.495935 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:01.496397 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:01.497393 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:01.497856 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:01.498285 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:01.503388 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:01.534063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:01.534554 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:01.534992 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:01.535463 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lazy-loading 'fault' on Instance uuid 22f96567-e842-4352-9e40-e31d2f547937 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:13:01.575784 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:01.584105 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-871758fb-145a-404d-84f1-bf08185e5a88 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 200 len: 1328 microversion: 2.1 time: 0.101867 Aug 29 19:13:01.584723 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 393/786] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:01 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:01.832424 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:01.833145 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:01.840257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:01.840747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:01.841350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:01.841855 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:01.842312 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:01.842739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:01.874179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:01.892648 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=6 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:01.983652 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:01.992307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:01.994026 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:01.995592 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9b06d0d5-3f5a-4550-b32e-95c9bc9b1551 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1408 microversion: 2.20 time: 0.167019 Aug 29 19:13:01.996988 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 394/787] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:13:01 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:13:02.605817 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:02.607009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:02.609044 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=6 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:02.614873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:02.615390 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:02.615832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:02.616540 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:02.617030 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:02.617457 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:02.631320 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] HTTP exception thrown: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Request method failure captured: Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 HTTP/1.1 Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6E9_4bd8q-CHhO9dy-p4ywD7JjoK6Oszu36lBhBD1sKyZbtqt-MBL4Nu5qNHCe92fKQKfp6sQsbRRXhh9lBRBr_-rnIS6bgsShiru9yuUDeVe4AwsogoGD5COMRhcmwSYuP3eQ8IuECwXB1HwmhA8H-JhkzoUU-dIWB7GRt0YHxso Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:13:02.632997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}] Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 624a0a90866446439918bd65ce5ddc60 Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:13:02.634839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '22f96567-e842-4352-9e40-e31d2f547937'} Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:02.635789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:13:02.637419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:02.638886 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Returning 404 to user: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:02.638886 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8755b9f4-b639-4656-81bb-80bfee4a76f8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 404 len: 111 microversion: 2.1 time: 0.032590 Aug 29 19:13:02.638886 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 394/788] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:02 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:13:02.643433 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b4d8e044-7e29-494b-9ae5-1a7718167097 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '.version_select at 0x7f3d762f41f0>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:02.662059 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b4d8e044-7e29-494b-9ae5-1a7718167097 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693102324" status: 202 len: 0 microversion: 2.1 time: 0.022405 Aug 29 19:13:02.662619 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 395/789] 10.222.0.94 () {58 vars in 1221 bytes} [Mon Aug 29 19:13:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693102324 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:13:03.020971 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:03.021616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:03.027496 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:03.028075 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:03.028427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:03.029246 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:03.029669 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:03.030097 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:03.223210 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:03.232341 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:03.233820 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:03.234980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-20e94283-2ceb-47ea-bac5-b2b1b71cc0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1600 microversion: 2.20 time: 0.217965 Aug 29 19:13:03.235567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 395/790] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:13:03 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:13:03.259198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-da0bcc7c-8f14-4564-b941-3df41bcbca09 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:03.259786 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-da0bcc7c-8f14-4564-b941-3df41bcbca09 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:03.265865 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da0bcc7c-8f14-4564-b941-3df41bcbca09 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:03.266389 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da0bcc7c-8f14-4564-b941-3df41bcbca09 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:03.267035 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da0bcc7c-8f14-4564-b941-3df41bcbca09 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:03.267947 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da0bcc7c-8f14-4564-b941-3df41bcbca09 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:03.268236 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da0bcc7c-8f14-4564-b941-3df41bcbca09 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:03.269304 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da0bcc7c-8f14-4564-b941-3df41bcbca09 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:03.328175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6b2cb6c1-4f75-4bdd-9f20-307010674b60 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Action: 'create', calling method: .version_select at 0x7f3d761b29d0>, body: {"keypair": {"name": "tempest-keypair-1934521491", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI5xNfcDqJGOIcVYU2Z5rlUTRQu7y56DhHbTv59lsxOrHIoV7vHMXkif0UL3JoLT/rLW0xdLK/qfdaTC0JTSIdOiVPM1tqKMhQthVw79+/TdYkTWzje0ZXlAVJ5wIFTLg=="}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:03.344004 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-6b2cb6c1-4f75-4bdd-9f20-307010674b60 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Getting quotas for project 5dda60c835244f5f9c980ed1927d9784. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:13:03.347917 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-6b2cb6c1-4f75-4bdd-9f20-307010674b60 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Getting quotas for user 624a0a90866446439918bd65ce5ddc60 and project 5dda60c835244f5f9c980ed1927d9784. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:13:03.351127 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-da0bcc7c-8f14-4564-b941-3df41bcbca09 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096317 Aug 29 19:13:03.351825 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 396/791] 10.222.0.94 () {60 vars in 1316 bytes} [Mon Aug 29 19:13:03 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:13:03.371262 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6b2cb6c1-4f75-4bdd-9f20-307010674b60 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046964 Aug 29 19:13:03.372411 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 396/792] 10.222.0.94 () {60 vars in 1159 bytes} [Mon Aug 29 19:13:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:13:04.336654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-27988a91-3c98-4e01-b09f-238c72a119ec req-f06a7c54-e96f-4e7a-a051-a5a7863beccc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9713d174-1918-4168-b6e7-bf1359b50155", "tag": "d4371ad0-840e-40ed-b29d-5fdc435f7837"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:04.346657 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-27988a91-3c98-4e01-b09f-238c72a119ec req-f06a7c54-e96f-4e7a-a051-a5a7863beccc service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:04.347314 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-27988a91-3c98-4e01-b09f-238c72a119ec req-f06a7c54-e96f-4e7a-a051-a5a7863beccc service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:04.347843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-27988a91-3c98-4e01-b09f-238c72a119ec req-f06a7c54-e96f-4e7a-a051-a5a7863beccc service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:04.359619 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-27988a91-3c98-4e01-b09f-238c72a119ec req-f06a7c54-e96f-4e7a-a051-a5a7863beccc service nova] Creating event network-changed:d4371ad0-840e-40ed-b29d-5fdc435f7837 for instance 9713d174-1918-4168-b6e7-bf1359b50155 on hv-cinder-73126 Aug 29 19:13:04.364826 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-27988a91-3c98-4e01-b09f-238c72a119ec req-f06a7c54-e96f-4e7a-a051-a5a7863beccc service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032204 Aug 29 19:13:04.365779 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 397/793] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:04.650565 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-873544109", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "72f0c062-bae6-4f61-bab2-9380409ee0e3"}], "security_groups": [{"name": "tempest-securitygroup--1943561739"}], "key_name": "tempest-keypair-1934521491", "user_data": "}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:04.845500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.network.neutron [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] validate_networks() for [('72f0c062-bae6-4f61-bab2-9380409ee0e3', None, None, None, None, None)] {{(pid=115968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:13:05.376949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:05.631616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Flavor limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:13:05.632049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Image limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:13:05.632548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Flavor pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:13:05.633014 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Image pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:13:05.633430 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:13:05.642732 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:05.643261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:05.643717 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:05.644421 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:05.644875 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:05.645304 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:05.662694 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Getting quotas for project 5dda60c835244f5f9c980ed1927d9784. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:13:05.667350 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Getting quotas for user 624a0a90866446439918bd65ce5ddc60 and project 5dda60c835244f5f9c980ed1927d9784. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:13:05.679385 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Going to run 1 instances... {{(pid=115968) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:13:05.681691 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:13:05.695868 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-80aecebb-e5ff-413a-82b1-3ddb1e7f8131 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:05.696525 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-80aecebb-e5ff-413a-82b1-3ddb1e7f8131 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:05.702934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80aecebb-e5ff-413a-82b1-3ddb1e7f8131 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:05.703654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80aecebb-e5ff-413a-82b1-3ddb1e7f8131 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:05.704158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80aecebb-e5ff-413a-82b1-3ddb1e7f8131 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:05.705116 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80aecebb-e5ff-413a-82b1-3ddb1e7f8131 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:05.705824 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80aecebb-e5ff-413a-82b1-3ddb1e7f8131 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:05.706521 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-80aecebb-e5ff-413a-82b1-3ddb1e7f8131 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:05.733813 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-80aecebb-e5ff-413a-82b1-3ddb1e7f8131 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/ips" status: 200 len: 151 microversion: 2.1 time: 0.151483 Aug 29 19:13:05.734321 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e895dc05-b305-4fbd-aee1-6fb4ee85a360 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.088940 Aug 29 19:13:05.740961 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 398/794] 10.222.0.94 () {58 vars in 1248 bytes} [Mon Aug 29 19:13:05 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/ips => generated 151 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:13:05.741113 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 397/795] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:13:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 19:13:05.748813 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7fb1cbfc-8b66-4465-9a2a-e673c0f0d654 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:05.749529 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7fb1cbfc-8b66-4465-9a2a-e673c0f0d654 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:05.813485 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7fb1cbfc-8b66-4465-9a2a-e673c0f0d654 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:05.821286 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7fb1cbfc-8b66-4465-9a2a-e673c0f0d654 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1237 microversion: 2.1 time: 0.077088 Aug 29 19:13:05.822431 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 399/796] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:05 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:06.844583 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-acbd7035-b7ee-4648-9761-23397eaff863 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:06.845204 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-acbd7035-b7ee-4648-9761-23397eaff863 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:06.852178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acbd7035-b7ee-4648-9761-23397eaff863 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:06.852671 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acbd7035-b7ee-4648-9761-23397eaff863 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:06.853111 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acbd7035-b7ee-4648-9761-23397eaff863 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:06.853806 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acbd7035-b7ee-4648-9761-23397eaff863 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:06.854265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acbd7035-b7ee-4648-9761-23397eaff863 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:06.854692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-acbd7035-b7ee-4648-9761-23397eaff863 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:06.919373 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-acbd7035-b7ee-4648-9761-23397eaff863 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:06.927041 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-acbd7035-b7ee-4648-9761-23397eaff863 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1289 microversion: 2.1 time: 0.087665 Aug 29 19:13:06.927620 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 398/797] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:06 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:07.096101 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a9b8e55b-3669-439c-afa5-b112ad25e455 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b985266-d59d-467e-aac7-e4e42514f413"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:07.098477 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a9b8e55b-3669-439c-afa5-b112ad25e455 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:07.107371 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9b8e55b-3669-439c-afa5-b112ad25e455 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:07.107864 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9b8e55b-3669-439c-afa5-b112ad25e455 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:07.108313 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9b8e55b-3669-439c-afa5-b112ad25e455 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:07.109012 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9b8e55b-3669-439c-afa5-b112ad25e455 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:07.109478 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9b8e55b-3669-439c-afa5-b112ad25e455 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:07.109910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a9b8e55b-3669-439c-afa5-b112ad25e455 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:07.485594 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a9b8e55b-3669-439c-afa5-b112ad25e455 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393320 Aug 29 19:13:07.489942 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 400/798] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:13:07 2022] POST /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:07.947843 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-dd9627f8-9efe-4039-9e1a-4c58767e51cc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:07.948453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-dd9627f8-9efe-4039-9e1a-4c58767e51cc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:07.956283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dd9627f8-9efe-4039-9e1a-4c58767e51cc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:07.956798 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dd9627f8-9efe-4039-9e1a-4c58767e51cc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:07.957234 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dd9627f8-9efe-4039-9e1a-4c58767e51cc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:07.957934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dd9627f8-9efe-4039-9e1a-4c58767e51cc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:07.958387 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dd9627f8-9efe-4039-9e1a-4c58767e51cc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:07.958812 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dd9627f8-9efe-4039-9e1a-4c58767e51cc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:08.034998 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-dd9627f8-9efe-4039-9e1a-4c58767e51cc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:08.044195 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-dd9627f8-9efe-4039-9e1a-4c58767e51cc tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1295 microversion: 2.1 time: 0.099397 Aug 29 19:13:08.044847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 399/799] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:07 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1295 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:08.688335 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-19b5b9b3-441e-4bd6-a60a-25ff658deb46 req-5048e270-5119-466d-a766-9b3a54a6be65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3536f9-d021-4b6f-8cbf-39f78138bccd", "tag": "86571d83-f032-4925-a522-e017c5c41946"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:08.702013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-19b5b9b3-441e-4bd6-a60a-25ff658deb46 req-5048e270-5119-466d-a766-9b3a54a6be65 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:08.702780 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-19b5b9b3-441e-4bd6-a60a-25ff658deb46 req-5048e270-5119-466d-a766-9b3a54a6be65 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:08.703415 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-19b5b9b3-441e-4bd6-a60a-25ff658deb46 req-5048e270-5119-466d-a766-9b3a54a6be65 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:08.716706 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-19b5b9b3-441e-4bd6-a60a-25ff658deb46 req-5048e270-5119-466d-a766-9b3a54a6be65 service nova] Creating event network-changed:86571d83-f032-4925-a522-e017c5c41946 for instance aa3536f9-d021-4b6f-8cbf-39f78138bccd on hv-cinder-73126 Aug 29 19:13:08.721604 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-19b5b9b3-441e-4bd6-a60a-25ff658deb46 req-5048e270-5119-466d-a766-9b3a54a6be65 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038158 Aug 29 19:13:08.722208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 401/800] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:09.065664 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-648075ac-0495-443e-8a41-b332d2f26b91 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:09.066306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-648075ac-0495-443e-8a41-b332d2f26b91 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:09.072880 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-648075ac-0495-443e-8a41-b332d2f26b91 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:09.073368 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-648075ac-0495-443e-8a41-b332d2f26b91 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:09.073803 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-648075ac-0495-443e-8a41-b332d2f26b91 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:09.074499 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-648075ac-0495-443e-8a41-b332d2f26b91 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:09.075144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-648075ac-0495-443e-8a41-b332d2f26b91 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:09.075598 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-648075ac-0495-443e-8a41-b332d2f26b91 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:09.229392 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-648075ac-0495-443e-8a41-b332d2f26b91 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:09.239334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-648075ac-0495-443e-8a41-b332d2f26b91 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1363 microversion: 2.1 time: 0.177306 Aug 29 19:13:09.239903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 400/801] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:09 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:10.261807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f5e58201-efa2-46ff-a5f0-d16b5566694c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:10.263196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f5e58201-efa2-46ff-a5f0-d16b5566694c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:10.269453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5e58201-efa2-46ff-a5f0-d16b5566694c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:10.269944 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5e58201-efa2-46ff-a5f0-d16b5566694c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:10.270387 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5e58201-efa2-46ff-a5f0-d16b5566694c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:10.271198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5e58201-efa2-46ff-a5f0-d16b5566694c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:10.271806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5e58201-efa2-46ff-a5f0-d16b5566694c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:10.272221 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5e58201-efa2-46ff-a5f0-d16b5566694c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:10.402061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f5e58201-efa2-46ff-a5f0-d16b5566694c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:10.410467 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f5e58201-efa2-46ff-a5f0-d16b5566694c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1363 microversion: 2.1 time: 0.153480 Aug 29 19:13:10.411146 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 402/802] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:10 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:11.432582 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2eee64a6-54b4-40d7-9c22-3c9375a8384f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:11.433307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2eee64a6-54b4-40d7-9c22-3c9375a8384f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:11.439987 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2eee64a6-54b4-40d7-9c22-3c9375a8384f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:11.440507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2eee64a6-54b4-40d7-9c22-3c9375a8384f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:11.440946 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2eee64a6-54b4-40d7-9c22-3c9375a8384f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:11.441627 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2eee64a6-54b4-40d7-9c22-3c9375a8384f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:11.442071 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2eee64a6-54b4-40d7-9c22-3c9375a8384f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:11.442489 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2eee64a6-54b4-40d7-9c22-3c9375a8384f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:11.574224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2eee64a6-54b4-40d7-9c22-3c9375a8384f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:11.582592 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2eee64a6-54b4-40d7-9c22-3c9375a8384f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1363 microversion: 2.1 time: 0.153851 Aug 29 19:13:11.583180 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 401/803] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:11 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:12.603296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-788a261b-c4b4-447d-a0c6-90c8dea091d0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:12.603914 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-788a261b-c4b4-447d-a0c6-90c8dea091d0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:12.610658 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-788a261b-c4b4-447d-a0c6-90c8dea091d0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:12.611182 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-788a261b-c4b4-447d-a0c6-90c8dea091d0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:12.611628 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-788a261b-c4b4-447d-a0c6-90c8dea091d0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:12.612324 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-788a261b-c4b4-447d-a0c6-90c8dea091d0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:12.612785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-788a261b-c4b4-447d-a0c6-90c8dea091d0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:12.613216 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-788a261b-c4b4-447d-a0c6-90c8dea091d0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:12.744327 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-788a261b-c4b4-447d-a0c6-90c8dea091d0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:12.752884 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-788a261b-c4b4-447d-a0c6-90c8dea091d0 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1363 microversion: 2.1 time: 0.153509 Aug 29 19:13:12.753455 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 403/804] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:12 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:13.773904 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d8dd27de-f47f-4054-956f-1164fcb3064c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:13.774458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d8dd27de-f47f-4054-956f-1164fcb3064c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:13.782989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8dd27de-f47f-4054-956f-1164fcb3064c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:13.783499 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8dd27de-f47f-4054-956f-1164fcb3064c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:13.784017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8dd27de-f47f-4054-956f-1164fcb3064c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:13.784682 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8dd27de-f47f-4054-956f-1164fcb3064c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:13.785164 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8dd27de-f47f-4054-956f-1164fcb3064c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:13.785613 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8dd27de-f47f-4054-956f-1164fcb3064c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:13.863595 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-90b5a8b9-d214-4e82-bef2-e2252b6cae32 req-8ae35ad7-0760-4961-adbe-512d59c506c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3536f9-d021-4b6f-8cbf-39f78138bccd", "name": "network-vif-plugged", "status": "completed", "tag": "86571d83-f032-4925-a522-e017c5c41946"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:13.874078 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-90b5a8b9-d214-4e82-bef2-e2252b6cae32 req-8ae35ad7-0760-4961-adbe-512d59c506c7 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:13.874568 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-90b5a8b9-d214-4e82-bef2-e2252b6cae32 req-8ae35ad7-0760-4961-adbe-512d59c506c7 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:13.875000 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-90b5a8b9-d214-4e82-bef2-e2252b6cae32 req-8ae35ad7-0760-4961-adbe-512d59c506c7 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:13.890421 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-90b5a8b9-d214-4e82-bef2-e2252b6cae32 req-8ae35ad7-0760-4961-adbe-512d59c506c7 service nova] Creating event network-vif-plugged:86571d83-f032-4925-a522-e017c5c41946 for instance aa3536f9-d021-4b6f-8cbf-39f78138bccd on hv-cinder-73126 Aug 29 19:13:13.895501 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-90b5a8b9-d214-4e82-bef2-e2252b6cae32 req-8ae35ad7-0760-4961-adbe-512d59c506c7 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036466 Aug 29 19:13:13.896483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 404/805] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:13.936863 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d8dd27de-f47f-4054-956f-1164fcb3064c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:13.944486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d8dd27de-f47f-4054-956f-1164fcb3064c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1363 microversion: 2.1 time: 0.174690 Aug 29 19:13:13.945057 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 402/806] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:13 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:14.966564 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a18dbdda-fb62-44ef-948f-4e7518cc3f50 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:14.967308 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a18dbdda-fb62-44ef-948f-4e7518cc3f50 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:14.973613 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a18dbdda-fb62-44ef-948f-4e7518cc3f50 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:14.974105 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a18dbdda-fb62-44ef-948f-4e7518cc3f50 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:14.974607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a18dbdda-fb62-44ef-948f-4e7518cc3f50 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:14.975368 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a18dbdda-fb62-44ef-948f-4e7518cc3f50 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:14.975835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a18dbdda-fb62-44ef-948f-4e7518cc3f50 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:14.976261 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a18dbdda-fb62-44ef-948f-4e7518cc3f50 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:15.058233 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b985266-d59d-467e-aac7-e4e42514f413"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:15.061010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:15.067877 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:15.068364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:15.068795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:15.069486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:15.069936 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:15.070357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:15.111900 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a18dbdda-fb62-44ef-948f-4e7518cc3f50 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:15.120143 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a18dbdda-fb62-44ef-948f-4e7518cc3f50 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1363 microversion: 2.1 time: 0.159137 Aug 29 19:13:15.121192 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 405/807] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:14 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:15.157130 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Invalid volume: volume 8b985266-d59d-467e-aac7-e4e42514f413 is already attached to instances: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: POST /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments HTTP/1.1 Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 74 Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:13:15.158719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {"volumeAttachment": {"volumeId": "8b985266-d59d-467e-aac7-e4e42514f413"}} Aug 29 19:13:15.160339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Invalid volume: volume 8b985266-d59d-467e-aac7-e4e42514f413 is already attached to instances: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'server_id': '0ddcbed3-129a-497b-aefb-a8a42ad2aec6', 'body': {'volumeAttachment': {'volumeId': '8b985266-d59d-467e-aac7-e4e42514f413'}}} Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8b985266-d59d-467e-aac7-e4e42514f413 is already attached to instances: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:15.161404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8b985266-d59d-467e-aac7-e4e42514f413 is already attached to instances: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:15.162870 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:15.164517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:15.164517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:15.164517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:15.164517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8b985266-d59d-467e-aac7-e4e42514f413 is already attached to instances: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 Aug 29 19:13:15.164517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:15.164517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 400 to user: Invalid volume: volume 8b985266-d59d-467e-aac7-e4e42514f413 is already attached to instances: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:15.164517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-38da5121-96a8-4f2b-a480-8172b4705f1b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106140 Aug 29 19:13:15.164517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 403/808] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:13:15 2022] POST /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 19:13:15.225058 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-86aa6c69-b869-4d38-90c8-f2a0063da83e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:15.225496 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-86aa6c69-b869-4d38-90c8-f2a0063da83e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:15.231691 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86aa6c69-b869-4d38-90c8-f2a0063da83e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:15.232177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86aa6c69-b869-4d38-90c8-f2a0063da83e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:15.232612 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86aa6c69-b869-4d38-90c8-f2a0063da83e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:15.233307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86aa6c69-b869-4d38-90c8-f2a0063da83e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:15.233765 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86aa6c69-b869-4d38-90c8-f2a0063da83e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:15.234189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-86aa6c69-b869-4d38-90c8-f2a0063da83e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:15.315364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-86aa6c69-b869-4d38-90c8-f2a0063da83e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lazy-loading 'services' on Instance uuid 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:13:15.392380 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-86aa6c69-b869-4d38-90c8-f2a0063da83e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments/8b985266-d59d-467e-aac7-e4e42514f413" status: 202 len: 0 microversion: 2.1 time: 0.170838 Aug 29 19:13:15.393270 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 406/809] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:13:15 2022] DELETE /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments/8b985266-d59d-467e-aac7-e4e42514f413 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:13:15.401598 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-cec9544c-6ef7-45a2-bcb3-795a0837405e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:15.404197 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-cec9544c-6ef7-45a2-bcb3-795a0837405e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:15.411062 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cec9544c-6ef7-45a2-bcb3-795a0837405e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:15.411572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cec9544c-6ef7-45a2-bcb3-795a0837405e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:15.412008 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cec9544c-6ef7-45a2-bcb3-795a0837405e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:15.412704 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cec9544c-6ef7-45a2-bcb3-795a0837405e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:15.413159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cec9544c-6ef7-45a2-bcb3-795a0837405e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:15.413581 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cec9544c-6ef7-45a2-bcb3-795a0837405e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:15.445316 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-cec9544c-6ef7-45a2-bcb3-795a0837405e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047684 Aug 29 19:13:15.445862 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 404/810] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:13:15 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:16.139897 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:16.144580 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-06e03f64-07b9-4c21-86d8-4397db5af2d9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:16.145275 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-06e03f64-07b9-4c21-86d8-4397db5af2d9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:16.151732 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-06e03f64-07b9-4c21-86d8-4397db5af2d9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:16.152220 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-06e03f64-07b9-4c21-86d8-4397db5af2d9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:16.152655 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-06e03f64-07b9-4c21-86d8-4397db5af2d9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:16.153573 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-06e03f64-07b9-4c21-86d8-4397db5af2d9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:16.154034 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-06e03f64-07b9-4c21-86d8-4397db5af2d9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:16.154460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-06e03f64-07b9-4c21-86d8-4397db5af2d9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:16.289164 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-06e03f64-07b9-4c21-86d8-4397db5af2d9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:16.297789 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-06e03f64-07b9-4c21-86d8-4397db5af2d9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1363 microversion: 2.1 time: 0.158941 Aug 29 19:13:16.298600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 407/811] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:16 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:16.457235 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-64637518-9401-4ee4-b98f-5644cb75a5b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:16.459344 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-64637518-9401-4ee4-b98f-5644cb75a5b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:16.461200 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:16.461874 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=10 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:16.468524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-64637518-9401-4ee4-b98f-5644cb75a5b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:16.469007 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-64637518-9401-4ee4-b98f-5644cb75a5b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:16.469436 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-64637518-9401-4ee4-b98f-5644cb75a5b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:16.470119 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-64637518-9401-4ee4-b98f-5644cb75a5b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:16.470564 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-64637518-9401-4ee4-b98f-5644cb75a5b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:16.470980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-64637518-9401-4ee4-b98f-5644cb75a5b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:16.650973 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-64637518-9401-4ee4-b98f-5644cb75a5b6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197655 Aug 29 19:13:16.651552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 405/812] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:13:16 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:17.319614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1ed51f37-1e25-43b8-bfc6-419f0f7a57f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:17.320270 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1ed51f37-1e25-43b8-bfc6-419f0f7a57f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:17.327379 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ed51f37-1e25-43b8-bfc6-419f0f7a57f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:17.327865 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ed51f37-1e25-43b8-bfc6-419f0f7a57f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:17.328302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ed51f37-1e25-43b8-bfc6-419f0f7a57f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:17.328988 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ed51f37-1e25-43b8-bfc6-419f0f7a57f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:17.329501 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ed51f37-1e25-43b8-bfc6-419f0f7a57f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:17.329922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ed51f37-1e25-43b8-bfc6-419f0f7a57f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:17.466739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1ed51f37-1e25-43b8-bfc6-419f0f7a57f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:17.474726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1ed51f37-1e25-43b8-bfc6-419f0f7a57f6 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1549 microversion: 2.1 time: 0.159015 Aug 29 19:13:17.475329 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 408/813] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:17 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:17.495187 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-69f027a3-3c4a-46a1-9c12-11c4b670a3cb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:17.495762 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-69f027a3-3c4a-46a1-9c12-11c4b670a3cb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:17.503015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-69f027a3-3c4a-46a1-9c12-11c4b670a3cb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:17.503590 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-69f027a3-3c4a-46a1-9c12-11c4b670a3cb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:17.504054 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-69f027a3-3c4a-46a1-9c12-11c4b670a3cb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:17.504755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-69f027a3-3c4a-46a1-9c12-11c4b670a3cb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:17.505226 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-69f027a3-3c4a-46a1-9c12-11c4b670a3cb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:17.505662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-69f027a3-3c4a-46a1-9c12-11c4b670a3cb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:17.583291 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-69f027a3-3c4a-46a1-9c12-11c4b670a3cb tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092066 Aug 29 19:13:17.583883 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 406/814] 10.222.0.94 () {58 vars in 1275 bytes} [Mon Aug 29 19:13:17 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:17.664272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-4e90873e-69bb-4113-a030-ef1d20c8c068 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:17.666502 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-4e90873e-69bb-4113-a030-ef1d20c8c068 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:17.673243 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e90873e-69bb-4113-a030-ef1d20c8c068 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:17.673743 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e90873e-69bb-4113-a030-ef1d20c8c068 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:17.674184 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e90873e-69bb-4113-a030-ef1d20c8c068 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:17.674889 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e90873e-69bb-4113-a030-ef1d20c8c068 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:17.675378 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e90873e-69bb-4113-a030-ef1d20c8c068 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:17.675804 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e90873e-69bb-4113-a030-ef1d20c8c068 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:17.706984 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-4e90873e-69bb-4113-a030-ef1d20c8c068 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046627 Aug 29 19:13:17.707603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 409/815] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:13:17 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:13:17.771214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e09907cd-8f60-42dc-84fb-e172035c3532 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:17.771802 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e09907cd-8f60-42dc-84fb-e172035c3532 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:17.777903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e09907cd-8f60-42dc-84fb-e172035c3532 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:17.778619 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e09907cd-8f60-42dc-84fb-e172035c3532 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:17.779179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e09907cd-8f60-42dc-84fb-e172035c3532 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:17.779953 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e09907cd-8f60-42dc-84fb-e172035c3532 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:17.780490 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e09907cd-8f60-42dc-84fb-e172035c3532 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:17.781000 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e09907cd-8f60-42dc-84fb-e172035c3532 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:17.808084 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e09907cd-8f60-42dc-84fb-e172035c3532 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Going to try to terminate instance {{(pid=115968) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:13:17.888190 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e09907cd-8f60-42dc-84fb-e172035c3532 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 204 len: 0 microversion: 2.1 time: 0.119861 Aug 29 19:13:17.892358 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 407/816] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:13:17 2022] DELETE /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:13:17.897831 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9ade7d84-7081-4895-b368-ea912f715e36 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:17.898784 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9ade7d84-7081-4895-b368-ea912f715e36 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:17.905534 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ade7d84-7081-4895-b368-ea912f715e36 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:17.906391 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ade7d84-7081-4895-b368-ea912f715e36 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:17.906920 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ade7d84-7081-4895-b368-ea912f715e36 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:17.907749 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ade7d84-7081-4895-b368-ea912f715e36 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:17.908329 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ade7d84-7081-4895-b368-ea912f715e36 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:17.908861 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9ade7d84-7081-4895-b368-ea912f715e36 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:18.148898 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9ade7d84-7081-4895-b368-ea912f715e36 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:18.157960 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9ade7d84-7081-4895-b368-ea912f715e36 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1684 microversion: 2.1 time: 0.264216 Aug 29 19:13:18.158549 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 410/817] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:17 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1684 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:18.900095 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-f3d01194-a25f-41ba-8174-759bac25eb9d req-c7cd000c-1a78-49c1-8e65-b227dccbcb90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3536f9-d021-4b6f-8cbf-39f78138bccd", "tag": "86571d83-f032-4925-a522-e017c5c41946"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:18.910798 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-f3d01194-a25f-41ba-8174-759bac25eb9d req-c7cd000c-1a78-49c1-8e65-b227dccbcb90 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:18.911314 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-f3d01194-a25f-41ba-8174-759bac25eb9d req-c7cd000c-1a78-49c1-8e65-b227dccbcb90 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:18.911744 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-f3d01194-a25f-41ba-8174-759bac25eb9d req-c7cd000c-1a78-49c1-8e65-b227dccbcb90 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:18.922464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-f3d01194-a25f-41ba-8174-759bac25eb9d req-c7cd000c-1a78-49c1-8e65-b227dccbcb90 service nova] Creating event network-changed:86571d83-f032-4925-a522-e017c5c41946 for instance aa3536f9-d021-4b6f-8cbf-39f78138bccd on hv-cinder-73126 Aug 29 19:13:18.927651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-f3d01194-a25f-41ba-8174-759bac25eb9d req-c7cd000c-1a78-49c1-8e65-b227dccbcb90 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091586 Aug 29 19:13:18.928247 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 408/818] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:19.180096 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3497b855-fb9a-4ecc-b347-760895e8bbcd tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:19.180718 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3497b855-fb9a-4ecc-b347-760895e8bbcd tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:19.187477 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3497b855-fb9a-4ecc-b347-760895e8bbcd tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:19.187969 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3497b855-fb9a-4ecc-b347-760895e8bbcd tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:19.188405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3497b855-fb9a-4ecc-b347-760895e8bbcd tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:19.189104 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3497b855-fb9a-4ecc-b347-760895e8bbcd tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:19.189563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3497b855-fb9a-4ecc-b347-760895e8bbcd tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:19.190085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3497b855-fb9a-4ecc-b347-760895e8bbcd tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:19.322890 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3497b855-fb9a-4ecc-b347-760895e8bbcd tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:19.330915 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3497b855-fb9a-4ecc-b347-760895e8bbcd tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1684 microversion: 2.1 time: 0.154762 Aug 29 19:13:19.331512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 411/819] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:19 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:20.353758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-159272f6-d9d0-41c8-bda9-581cc4b41624 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:20.354975 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-159272f6-d9d0-41c8-bda9-581cc4b41624 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:20.364292 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-159272f6-d9d0-41c8-bda9-581cc4b41624 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:20.365095 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-159272f6-d9d0-41c8-bda9-581cc4b41624 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:20.365802 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-159272f6-d9d0-41c8-bda9-581cc4b41624 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:20.366951 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-159272f6-d9d0-41c8-bda9-581cc4b41624 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:20.367744 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-159272f6-d9d0-41c8-bda9-581cc4b41624 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:20.368451 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-159272f6-d9d0-41c8-bda9-581cc4b41624 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:20.519170 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-159272f6-d9d0-41c8-bda9-581cc4b41624 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:20.529604 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-159272f6-d9d0-41c8-bda9-581cc4b41624 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1684 microversion: 2.1 time: 0.181511 Aug 29 19:13:20.530188 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 409/820] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:20 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1684 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:20.944943 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-1c5d37fc-0981-4da2-82e2-ffd423ba960c req-c13ecad5-72ca-4aa3-a1d9-81dc18819ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ddcbed3-129a-497b-aefb-a8a42ad2aec6", "name": "network-vif-deleted", "tag": "547abed6-9c9a-44ab-8528-0a763a1230f2"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:20.962535 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-1c5d37fc-0981-4da2-82e2-ffd423ba960c req-c13ecad5-72ca-4aa3-a1d9-81dc18819ea6 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:20.963575 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-1c5d37fc-0981-4da2-82e2-ffd423ba960c req-c13ecad5-72ca-4aa3-a1d9-81dc18819ea6 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:20.964642 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-1c5d37fc-0981-4da2-82e2-ffd423ba960c req-c13ecad5-72ca-4aa3-a1d9-81dc18819ea6 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:20.985100 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-1c5d37fc-0981-4da2-82e2-ffd423ba960c req-c13ecad5-72ca-4aa3-a1d9-81dc18819ea6 service nova] Creating event network-vif-deleted:547abed6-9c9a-44ab-8528-0a763a1230f2 for instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 on hv-cinder-73126 Aug 29 19:13:20.991956 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-1c5d37fc-0981-4da2-82e2-ffd423ba960c req-c13ecad5-72ca-4aa3-a1d9-81dc18819ea6 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050352 Aug 29 19:13:20.993247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 412/821] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:21.550377 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:21.550988 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:21.557293 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:21.557781 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:21.558214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:21.558905 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:21.559894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:21.560385 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:21.591449 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:21.591931 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:21.592364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:21.592809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lazy-loading 'fault' on Instance uuid 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:13:21.638708 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:21.642581 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:21.648002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e5171842-88d4-402e-8901-61d8f2bca4f0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 200 len: 1332 microversion: 2.1 time: 0.101424 Aug 29 19:13:21.648582 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 410/822] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:21 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:22.669665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:22.670359 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:22.677161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:22.677654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:22.678077 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:22.678767 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:22.679252 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:22.679679 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:22.693417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 HTTP/1.1 Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:13:22.695061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:13:22.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '0ddcbed3-129a-497b-aefb-a8a42ad2aec6'} Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:22.697533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:13:22.698711 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:22.699871 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:22.699871 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-35424df7-9e8f-40a9-a67d-7ca042113ed9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 404 len: 111 microversion: 2.1 time: 0.031915 Aug 29 19:13:22.699871 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 413/823] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:22 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:13:22.706542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-10e4ac64-cbaf-4124-b257-42cad76565a6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '.version_select at 0x7f3d762f8670>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:22.727646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-10e4ac64-cbaf-4124-b257-42cad76565a6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130768746" status: 202 len: 0 microversion: 2.1 time: 0.025789 Aug 29 19:13:22.728220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 411/824] 10.222.0.94 () {58 vars in 1221 bytes} [Mon Aug 29 19:13:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2130768746 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:13:23.184739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6c333935-fb78-49b6-a8da-ba8d2a5b60fd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:23.185423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6c333935-fb78-49b6-a8da-ba8d2a5b60fd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:23.191618 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c333935-fb78-49b6-a8da-ba8d2a5b60fd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:23.192103 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c333935-fb78-49b6-a8da-ba8d2a5b60fd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:23.192536 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c333935-fb78-49b6-a8da-ba8d2a5b60fd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:23.193227 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c333935-fb78-49b6-a8da-ba8d2a5b60fd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:23.193680 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c333935-fb78-49b6-a8da-ba8d2a5b60fd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:23.194098 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6c333935-fb78-49b6-a8da-ba8d2a5b60fd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:23.198349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:23.291922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-6c333935-fb78-49b6-a8da-ba8d2a5b60fd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lazy-loading 'services' on Instance uuid 0236f3d8-fe14-4ea6-a952-ad43a97260aa {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:13:23.349264 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-92d0d4d4-489e-4255-8335-49382f7f3fa1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: .version_select at 0x7f3d762e6820>, body: {"keypair": {"name": "tempest-keypair-547695508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0w/lc/HXqQhCY1J9pNoRSrNMm/JHr380SBrlGNlao4ZzAaR0iVBytCGDc7chXT4Y1fk8tB5lXNS5gHy3k2qy4JyM8EXSsrQGrQHdhvcRSaowk79HI2uRfL/C755zQ3Cw=="}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:23.365352 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6c333935-fb78-49b6-a8da-ba8d2a5b60fd tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "DELETE /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments/8ddf66ca-3b19-4b38-83a1-ec6ae7262f8c" status: 202 len: 0 microversion: 2.1 time: 0.184346 Aug 29 19:13:23.366315 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 414/825] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:13:23 2022] DELETE /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments/8ddf66ca-3b19-4b38-83a1-ec6ae7262f8c => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:13:23.369212 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-92d0d4d4-489e-4255-8335-49382f7f3fa1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for project b967c22662da47aeb9292704c39b44bb. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:13:23.374388 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-92d0d4d4-489e-4255-8335-49382f7f3fa1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for user ac0bc9e010d044a5a2147010cbdb4d85 and project b967c22662da47aeb9292704c39b44bb. Resources: {'key_pairs'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:13:23.379109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-52a52464-a93f-494c-b601-64804ba2ae4b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:23.381606 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-52a52464-a93f-494c-b601-64804ba2ae4b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:23.389008 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52a52464-a93f-494c-b601-64804ba2ae4b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:23.389583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52a52464-a93f-494c-b601-64804ba2ae4b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:23.390088 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52a52464-a93f-494c-b601-64804ba2ae4b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:23.390894 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52a52464-a93f-494c-b601-64804ba2ae4b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:23.391387 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52a52464-a93f-494c-b601-64804ba2ae4b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:23.391812 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-52a52464-a93f-494c-b601-64804ba2ae4b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:23.398984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-92d0d4d4-489e-4255-8335-49382f7f3fa1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053657 Aug 29 19:13:23.399624 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 412/826] 10.222.0.94 () {60 vars in 1159 bytes} [Mon Aug 29 19:13:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:13:23.424786 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-52a52464-a93f-494c-b601-64804ba2ae4b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053874 Aug 29 19:13:23.425361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 415/827] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:13:23 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:13:24.033590 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3aa99b0f-64a8-4a78-9ccb-96c9418fea77 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:24.034224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3aa99b0f-64a8-4a78-9ccb-96c9418fea77 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:24.040858 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3aa99b0f-64a8-4a78-9ccb-96c9418fea77 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:24.041384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3aa99b0f-64a8-4a78-9ccb-96c9418fea77 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:24.041827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3aa99b0f-64a8-4a78-9ccb-96c9418fea77 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:24.042789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3aa99b0f-64a8-4a78-9ccb-96c9418fea77 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:24.043280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3aa99b0f-64a8-4a78-9ccb-96c9418fea77 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:24.043711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3aa99b0f-64a8-4a78-9ccb-96c9418fea77 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:24.070423 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3aa99b0f-64a8-4a78-9ccb-96c9418fea77 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Going to try to terminate instance {{(pid=115968) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:13:24.159089 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3aa99b0f-64a8-4a78-9ccb-96c9418fea77 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "DELETE /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 204 len: 0 microversion: 2.1 time: 0.129880 Aug 29 19:13:24.160243 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 413/828] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:13:24 2022] DELETE /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:13:24.171199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c1474b4e-45db-4fd8-b4be-45e5fa49b7d9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:24.172540 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c1474b4e-45db-4fd8-b4be-45e5fa49b7d9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:24.181098 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1474b4e-45db-4fd8-b4be-45e5fa49b7d9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:24.181624 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1474b4e-45db-4fd8-b4be-45e5fa49b7d9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:24.182128 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1474b4e-45db-4fd8-b4be-45e5fa49b7d9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:24.182898 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1474b4e-45db-4fd8-b4be-45e5fa49b7d9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:24.183379 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1474b4e-45db-4fd8-b4be-45e5fa49b7d9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:24.183806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1474b4e-45db-4fd8-b4be-45e5fa49b7d9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:24.331180 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c1474b4e-45db-4fd8-b4be-45e5fa49b7d9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:24.339226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c1474b4e-45db-4fd8-b4be-45e5fa49b7d9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1578 microversion: 2.1 time: 0.174664 Aug 29 19:13:24.340197 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 416/829] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:24 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:24.437648 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-183ed7b8-77d0-4119-af3e-6e2d7d497088 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:24.439900 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-183ed7b8-77d0-4119-af3e-6e2d7d497088 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:24.446007 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-183ed7b8-77d0-4119-af3e-6e2d7d497088 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:24.446501 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-183ed7b8-77d0-4119-af3e-6e2d7d497088 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:24.446944 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-183ed7b8-77d0-4119-af3e-6e2d7d497088 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:24.447700 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-183ed7b8-77d0-4119-af3e-6e2d7d497088 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:24.448159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-183ed7b8-77d0-4119-af3e-6e2d7d497088 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:24.448596 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-183ed7b8-77d0-4119-af3e-6e2d7d497088 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:24.480314 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-183ed7b8-77d0-4119-af3e-6e2d7d497088 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047049 Aug 29 19:13:24.480980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 414/830] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:13:24 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:24.682663 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-479682590", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "117b2cb0-1215-4254-9d1f-c2728d00a788"}], "security_groups": [{"name": "tempest-securitygroup--2055543698"}], "key_name": "tempest-keypair-547695508", "user_data": "}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:24.787104 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] validate_networks() for [('117b2cb0-1215-4254-9d1f-c2728d00a788', None, None, None, None, None)] {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:13:25.201809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:13:25.202392 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:13:25.202697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:13:25.203138 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:13:25.203558 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:13:25.212354 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:25.212949 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:25.213391 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:25.214121 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:25.214580 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:25.215005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:25.232915 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for project b967c22662da47aeb9292704c39b44bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:13:25.236939 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Getting quotas for user ac0bc9e010d044a5a2147010cbdb4d85 and project b967c22662da47aeb9292704c39b44bb. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:13:25.248066 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:13:25.250367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:13:25.298019 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0372da4d-c541-4a12-a791-be63fcaef9fe tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.619718 Aug 29 19:13:25.298671 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 417/831] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:13:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:13:25.309699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-87d1713b-6c15-4403-a8fd-0e390ec26f14 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:25.310320 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-87d1713b-6c15-4403-a8fd-0e390ec26f14 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:25.363469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-012f455d-c2de-44e8-8830-e930991cce28 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:25.364691 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-012f455d-c2de-44e8-8830-e930991cce28 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:25.366554 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-87d1713b-6c15-4403-a8fd-0e390ec26f14 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:25.371818 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-012f455d-c2de-44e8-8830-e930991cce28 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:25.372357 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-012f455d-c2de-44e8-8830-e930991cce28 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:25.372936 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-012f455d-c2de-44e8-8830-e930991cce28 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:25.373676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-012f455d-c2de-44e8-8830-e930991cce28 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:25.374126 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-012f455d-c2de-44e8-8830-e930991cce28 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:25.374739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-012f455d-c2de-44e8-8830-e930991cce28 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:25.375207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-87d1713b-6c15-4403-a8fd-0e390ec26f14 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1240 microversion: 2.1 time: 0.069510 Aug 29 19:13:25.376333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 415/832] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:25 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:25.494413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b1105e9b-75da-4b2c-8dd6-38d457cadd03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:25.496671 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b1105e9b-75da-4b2c-8dd6-38d457cadd03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:25.504326 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1105e9b-75da-4b2c-8dd6-38d457cadd03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:25.504813 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1105e9b-75da-4b2c-8dd6-38d457cadd03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:25.505460 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1105e9b-75da-4b2c-8dd6-38d457cadd03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:25.506163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1105e9b-75da-4b2c-8dd6-38d457cadd03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:25.506676 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1105e9b-75da-4b2c-8dd6-38d457cadd03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:25.507132 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b1105e9b-75da-4b2c-8dd6-38d457cadd03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:25.515343 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-012f455d-c2de-44e8-8830-e930991cce28 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:25.526224 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-012f455d-c2de-44e8-8830-e930991cce28 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1578 microversion: 2.1 time: 0.166726 Aug 29 19:13:25.526959 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 418/833] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:25 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:25.545816 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b1105e9b-75da-4b2c-8dd6-38d457cadd03 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055068 Aug 29 19:13:25.547339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 416/834] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:13:25 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:13:26.395970 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a6371447-aca5-49d5-a287-2171ab7dad43 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:26.396581 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a6371447-aca5-49d5-a287-2171ab7dad43 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:26.404077 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6371447-aca5-49d5-a287-2171ab7dad43 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.405202 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6371447-aca5-49d5-a287-2171ab7dad43 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.405706 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6371447-aca5-49d5-a287-2171ab7dad43 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.406421 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6371447-aca5-49d5-a287-2171ab7dad43 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.406885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6371447-aca5-49d5-a287-2171ab7dad43 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.407519 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a6371447-aca5-49d5-a287-2171ab7dad43 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.486348 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a6371447-aca5-49d5-a287-2171ab7dad43 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:26.496141 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a6371447-aca5-49d5-a287-2171ab7dad43 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1292 microversion: 2.1 time: 0.103946 Aug 29 19:13:26.496719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 419/835] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:26 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:26.549197 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-76844b79-5a0d-4239-a368-0fa49df6decd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:26.550043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-76844b79-5a0d-4239-a368-0fa49df6decd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:26.556685 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76844b79-5a0d-4239-a368-0fa49df6decd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.557252 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76844b79-5a0d-4239-a368-0fa49df6decd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.557787 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76844b79-5a0d-4239-a368-0fa49df6decd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.557895 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7a32c1aa-1291-42de-b8fc-947c8db3aad6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:26.558560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76844b79-5a0d-4239-a368-0fa49df6decd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.559118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76844b79-5a0d-4239-a368-0fa49df6decd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.559758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-76844b79-5a0d-4239-a368-0fa49df6decd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.561120 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7a32c1aa-1291-42de-b8fc-947c8db3aad6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:26.567536 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7a32c1aa-1291-42de-b8fc-947c8db3aad6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.568030 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7a32c1aa-1291-42de-b8fc-947c8db3aad6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.568474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7a32c1aa-1291-42de-b8fc-947c8db3aad6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.569288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7a32c1aa-1291-42de-b8fc-947c8db3aad6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.569921 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7a32c1aa-1291-42de-b8fc-947c8db3aad6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.570354 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7a32c1aa-1291-42de-b8fc-947c8db3aad6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.608020 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7a32c1aa-1291-42de-b8fc-947c8db3aad6 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053285 Aug 29 19:13:26.608742 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 420/836] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:13:26 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 19:13:26.690866 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-93dd6770-86e6-4e2c-af0e-f4104a20fb42 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:26.691777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-93dd6770-86e6-4e2c-af0e-f4104a20fb42 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:26.699222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93dd6770-86e6-4e2c-af0e-f4104a20fb42 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.700848 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93dd6770-86e6-4e2c-af0e-f4104a20fb42 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.701531 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93dd6770-86e6-4e2c-af0e-f4104a20fb42 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.702535 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93dd6770-86e6-4e2c-af0e-f4104a20fb42 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.703247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93dd6770-86e6-4e2c-af0e-f4104a20fb42 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.703917 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-93dd6770-86e6-4e2c-af0e-f4104a20fb42 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.710465 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-76844b79-5a0d-4239-a368-0fa49df6decd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:26.720482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-76844b79-5a0d-4239-a368-0fa49df6decd tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1578 microversion: 2.1 time: 0.175562 Aug 29 19:13:26.721393 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 417/837] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:26 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:26.740830 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-93dd6770-86e6-4e2c-af0e-f4104a20fb42 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:13:26.829424 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-93dd6770-86e6-4e2c-af0e-f4104a20fb42 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "DELETE /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 204 len: 0 microversion: 2.1 time: 0.142256 Aug 29 19:13:26.839187 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 421/838] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:13:26 2022] DELETE /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:13:26.839932 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d07e3a86-1635-455c-ab40-8fd4ba090164 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:26.840546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d07e3a86-1635-455c-ab40-8fd4ba090164 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:26.849696 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d07e3a86-1635-455c-ab40-8fd4ba090164 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.851246 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d07e3a86-1635-455c-ab40-8fd4ba090164 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.852017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d07e3a86-1635-455c-ab40-8fd4ba090164 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:26.852717 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d07e3a86-1635-455c-ab40-8fd4ba090164 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:26.853548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d07e3a86-1635-455c-ab40-8fd4ba090164 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:26.853980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d07e3a86-1635-455c-ab40-8fd4ba090164 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:27.000922 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d07e3a86-1635-455c-ab40-8fd4ba090164 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:27.008770 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d07e3a86-1635-455c-ab40-8fd4ba090164 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1689 microversion: 2.1 time: 0.174545 Aug 29 19:13:27.009351 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 418/839] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:26 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:27.394866 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-a053622e-d0c8-4788-b3d3-c27ef9b0b615 req-abd7abf7-d3b4-4fa5-9238-f8eb92141cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b52e65bd-038e-4fc8-807e-4e4ce60c8db7", "name": "network-vif-deleted", "tag": "32fdb103-82cb-4537-9dfe-6532b2639a2a"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:27.405149 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-a053622e-d0c8-4788-b3d3-c27ef9b0b615 req-abd7abf7-d3b4-4fa5-9238-f8eb92141cfa service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:27.405814 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-a053622e-d0c8-4788-b3d3-c27ef9b0b615 req-abd7abf7-d3b4-4fa5-9238-f8eb92141cfa service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:27.406198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-a053622e-d0c8-4788-b3d3-c27ef9b0b615 req-abd7abf7-d3b4-4fa5-9238-f8eb92141cfa service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:27.420648 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-a053622e-d0c8-4788-b3d3-c27ef9b0b615 req-abd7abf7-d3b4-4fa5-9238-f8eb92141cfa service nova] Creating event network-vif-deleted:32fdb103-82cb-4537-9dfe-6532b2639a2a for instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 on hv-cinder-73126 Aug 29 19:13:27.425653 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-a053622e-d0c8-4788-b3d3-c27ef9b0b615 req-abd7abf7-d3b4-4fa5-9238-f8eb92141cfa service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090478 Aug 29 19:13:27.426261 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 422/840] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:27.518637 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ec8a346e-e825-4a61-9586-541115eeb16f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:27.519417 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ec8a346e-e825-4a61-9586-541115eeb16f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:27.525459 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ec8a346e-e825-4a61-9586-541115eeb16f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:27.526292 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ec8a346e-e825-4a61-9586-541115eeb16f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:27.526587 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ec8a346e-e825-4a61-9586-541115eeb16f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:27.527333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ec8a346e-e825-4a61-9586-541115eeb16f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:27.527804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ec8a346e-e825-4a61-9586-541115eeb16f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:27.528216 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ec8a346e-e825-4a61-9586-541115eeb16f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:27.609447 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ec8a346e-e825-4a61-9586-541115eeb16f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:27.617719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ec8a346e-e825-4a61-9586-541115eeb16f tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1300 microversion: 2.1 time: 0.104167 Aug 29 19:13:27.618310 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 419/841] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:27 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1300 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:27.744097 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-88318d22-c0bd-4863-a93a-c8dde1ec6e43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:27.744791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-88318d22-c0bd-4863-a93a-c8dde1ec6e43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:27.751736 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-88318d22-c0bd-4863-a93a-c8dde1ec6e43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:27.752221 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-88318d22-c0bd-4863-a93a-c8dde1ec6e43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:27.752675 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-88318d22-c0bd-4863-a93a-c8dde1ec6e43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:27.753345 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-88318d22-c0bd-4863-a93a-c8dde1ec6e43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:27.753797 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-88318d22-c0bd-4863-a93a-c8dde1ec6e43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:27.754217 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-88318d22-c0bd-4863-a93a-c8dde1ec6e43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:27.818044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-88318d22-c0bd-4863-a93a-c8dde1ec6e43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:27.825762 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-88318d22-c0bd-4863-a93a-c8dde1ec6e43 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1511 microversion: 2.1 time: 0.085918 Aug 29 19:13:27.826696 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 423/842] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:27 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1511 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:28.030661 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8ca7f659-320a-49f3-afa7-6ff81a690a59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:28.031319 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8ca7f659-320a-49f3-afa7-6ff81a690a59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:28.037668 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ca7f659-320a-49f3-afa7-6ff81a690a59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:28.038166 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ca7f659-320a-49f3-afa7-6ff81a690a59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:28.038609 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ca7f659-320a-49f3-afa7-6ff81a690a59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:28.039345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ca7f659-320a-49f3-afa7-6ff81a690a59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:28.039812 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ca7f659-320a-49f3-afa7-6ff81a690a59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:28.040240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8ca7f659-320a-49f3-afa7-6ff81a690a59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:28.179347 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8ca7f659-320a-49f3-afa7-6ff81a690a59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:28.188077 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8ca7f659-320a-49f3-afa7-6ff81a690a59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1689 microversion: 2.1 time: 0.162174 Aug 29 19:13:28.188656 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 420/843] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:28 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:28.640444 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-383f6f32-c769-4db5-9086-0c9f7e15f875 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:28.641055 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-383f6f32-c769-4db5-9086-0c9f7e15f875 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:28.647684 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-383f6f32-c769-4db5-9086-0c9f7e15f875 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:28.648170 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-383f6f32-c769-4db5-9086-0c9f7e15f875 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:28.648602 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-383f6f32-c769-4db5-9086-0c9f7e15f875 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:28.649321 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-383f6f32-c769-4db5-9086-0c9f7e15f875 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:28.649776 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-383f6f32-c769-4db5-9086-0c9f7e15f875 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:28.650199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-383f6f32-c769-4db5-9086-0c9f7e15f875 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:28.711680 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-383f6f32-c769-4db5-9086-0c9f7e15f875 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:28.719931 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-383f6f32-c769-4db5-9086-0c9f7e15f875 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1300 microversion: 2.1 time: 0.083959 Aug 29 19:13:28.720497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 424/844] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:28 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:28.846530 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-66c15867-858d-4a38-82dc-3044233c0d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:28.847176 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-66c15867-858d-4a38-82dc-3044233c0d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:28.853572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-66c15867-858d-4a38-82dc-3044233c0d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:28.854058 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-66c15867-858d-4a38-82dc-3044233c0d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:28.854489 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-66c15867-858d-4a38-82dc-3044233c0d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:28.855243 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-66c15867-858d-4a38-82dc-3044233c0d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:28.855699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-66c15867-858d-4a38-82dc-3044233c0d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:28.856124 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-66c15867-858d-4a38-82dc-3044233c0d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:28.920337 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-66c15867-858d-4a38-82dc-3044233c0d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:28.928226 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-66c15867-858d-4a38-82dc-3044233c0d74 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1511 microversion: 2.1 time: 0.085612 Aug 29 19:13:28.928793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 421/845] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:28 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:29.209776 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0193c6e3-dfbc-4d4f-b99f-22cbabc62c4d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:29.210398 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0193c6e3-dfbc-4d4f-b99f-22cbabc62c4d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:29.216529 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0193c6e3-dfbc-4d4f-b99f-22cbabc62c4d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:29.217015 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0193c6e3-dfbc-4d4f-b99f-22cbabc62c4d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:29.217608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0193c6e3-dfbc-4d4f-b99f-22cbabc62c4d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:29.218309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0193c6e3-dfbc-4d4f-b99f-22cbabc62c4d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:29.218778 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0193c6e3-dfbc-4d4f-b99f-22cbabc62c4d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:29.219240 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0193c6e3-dfbc-4d4f-b99f-22cbabc62c4d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:29.350011 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0193c6e3-dfbc-4d4f-b99f-22cbabc62c4d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:29.358498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0193c6e3-dfbc-4d4f-b99f-22cbabc62c4d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1689 microversion: 2.1 time: 0.152526 Aug 29 19:13:29.359092 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 425/846] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:29 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:29.740362 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fe7a6647-1dc2-4fe6-abea-3c793ed189aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:29.740970 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fe7a6647-1dc2-4fe6-abea-3c793ed189aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:29.746779 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fe7a6647-1dc2-4fe6-abea-3c793ed189aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:29.747303 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fe7a6647-1dc2-4fe6-abea-3c793ed189aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:29.747761 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fe7a6647-1dc2-4fe6-abea-3c793ed189aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:29.748574 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fe7a6647-1dc2-4fe6-abea-3c793ed189aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:29.749032 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fe7a6647-1dc2-4fe6-abea-3c793ed189aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:29.749455 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fe7a6647-1dc2-4fe6-abea-3c793ed189aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:29.811821 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fe7a6647-1dc2-4fe6-abea-3c793ed189aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:29.819576 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fe7a6647-1dc2-4fe6-abea-3c793ed189aa tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1300 microversion: 2.1 time: 0.083207 Aug 29 19:13:29.820166 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 422/847] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:29 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:29.955678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9694cf0e-04d1-413b-9e46-c04eb2e64f89 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:29.956291 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9694cf0e-04d1-413b-9e46-c04eb2e64f89 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:29.962646 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9694cf0e-04d1-413b-9e46-c04eb2e64f89 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:29.963262 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9694cf0e-04d1-413b-9e46-c04eb2e64f89 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:29.963678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9694cf0e-04d1-413b-9e46-c04eb2e64f89 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:29.964369 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9694cf0e-04d1-413b-9e46-c04eb2e64f89 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:29.964848 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9694cf0e-04d1-413b-9e46-c04eb2e64f89 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:29.965276 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9694cf0e-04d1-413b-9e46-c04eb2e64f89 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:30.027761 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9694cf0e-04d1-413b-9e46-c04eb2e64f89 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:30.036520 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9694cf0e-04d1-413b-9e46-c04eb2e64f89 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1511 microversion: 2.1 time: 0.085520 Aug 29 19:13:30.037094 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 426/848] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:29 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1511 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:30.379370 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7afe37e2-2077-45c4-8ac1-8183bb575b94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:30.379934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7afe37e2-2077-45c4-8ac1-8183bb575b94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:30.386343 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7afe37e2-2077-45c4-8ac1-8183bb575b94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:30.386837 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7afe37e2-2077-45c4-8ac1-8183bb575b94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:30.387312 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7afe37e2-2077-45c4-8ac1-8183bb575b94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:30.388004 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7afe37e2-2077-45c4-8ac1-8183bb575b94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:30.389199 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7afe37e2-2077-45c4-8ac1-8183bb575b94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:30.389697 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7afe37e2-2077-45c4-8ac1-8183bb575b94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:30.523289 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7afe37e2-2077-45c4-8ac1-8183bb575b94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:30.531203 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7afe37e2-2077-45c4-8ac1-8183bb575b94 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1689 microversion: 2.1 time: 0.155768 Aug 29 19:13:30.531759 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 423/849] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:30 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:30.840879 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f023c44b-8525-4732-b1f0-7ffaf42cfcb5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:30.841531 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f023c44b-8525-4732-b1f0-7ffaf42cfcb5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:30.843809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:30.849331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f023c44b-8525-4732-b1f0-7ffaf42cfcb5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:30.849813 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f023c44b-8525-4732-b1f0-7ffaf42cfcb5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:30.850288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f023c44b-8525-4732-b1f0-7ffaf42cfcb5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:30.850978 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f023c44b-8525-4732-b1f0-7ffaf42cfcb5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:30.851461 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f023c44b-8525-4732-b1f0-7ffaf42cfcb5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:30.851879 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f023c44b-8525-4732-b1f0-7ffaf42cfcb5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:30.921126 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f023c44b-8525-4732-b1f0-7ffaf42cfcb5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:30.935316 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f023c44b-8525-4732-b1f0-7ffaf42cfcb5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1310 microversion: 2.1 time: 0.098715 Aug 29 19:13:30.948106 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 427/850] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:30 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1310 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:31.057668 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1a0895cf-9a1c-493e-84db-04e705dcf05c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:31.058370 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1a0895cf-9a1c-493e-84db-04e705dcf05c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:31.064722 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1a0895cf-9a1c-493e-84db-04e705dcf05c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:31.065290 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1a0895cf-9a1c-493e-84db-04e705dcf05c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:31.065796 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1a0895cf-9a1c-493e-84db-04e705dcf05c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:31.066730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1a0895cf-9a1c-493e-84db-04e705dcf05c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:31.067292 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1a0895cf-9a1c-493e-84db-04e705dcf05c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:31.067800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1a0895cf-9a1c-493e-84db-04e705dcf05c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:31.170799 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1a0895cf-9a1c-493e-84db-04e705dcf05c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:31.180462 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1a0895cf-9a1c-493e-84db-04e705dcf05c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 200 len: 1226 microversion: 2.1 time: 0.126495 Aug 29 19:13:31.189567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 424/851] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:31 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 1226 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:31.552906 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9401ff4e-8666-4dc5-8ec7-bec59a12172b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:31.553520 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9401ff4e-8666-4dc5-8ec7-bec59a12172b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:31.564097 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9401ff4e-8666-4dc5-8ec7-bec59a12172b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:31.566445 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9401ff4e-8666-4dc5-8ec7-bec59a12172b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:31.567119 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9401ff4e-8666-4dc5-8ec7-bec59a12172b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:31.567852 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9401ff4e-8666-4dc5-8ec7-bec59a12172b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:31.574367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9401ff4e-8666-4dc5-8ec7-bec59a12172b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:31.575091 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9401ff4e-8666-4dc5-8ec7-bec59a12172b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:31.712051 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9401ff4e-8666-4dc5-8ec7-bec59a12172b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:31.725308 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9401ff4e-8666-4dc5-8ec7-bec59a12172b tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1622 microversion: 2.1 time: 0.176308 Aug 29 19:13:31.725901 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 428/852] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:31 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1622 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:31.958997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-36b0e039-ff63-4a33-bb14-ea1ca7a7190b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:31.959928 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-36b0e039-ff63-4a33-bb14-ea1ca7a7190b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:31.971537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-36b0e039-ff63-4a33-bb14-ea1ca7a7190b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:31.972015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-36b0e039-ff63-4a33-bb14-ea1ca7a7190b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:31.977762 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-36b0e039-ff63-4a33-bb14-ea1ca7a7190b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:31.978916 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-36b0e039-ff63-4a33-bb14-ea1ca7a7190b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:31.979516 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-36b0e039-ff63-4a33-bb14-ea1ca7a7190b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:31.982212 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-36b0e039-ff63-4a33-bb14-ea1ca7a7190b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:31.986733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-76ed9de8-9dcf-4bd6-8279-afe0fa4f8e80 req-5daa656f-e0ac-4d23-b50f-10020ded5ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0236f3d8-fe14-4ea6-a952-ad43a97260aa", "name": "network-vif-deleted", "tag": "f5ea5791-6357-48d5-bdaa-4b91eacc1a22"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:32.002757 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-76ed9de8-9dcf-4bd6-8279-afe0fa4f8e80 req-5daa656f-e0ac-4d23-b50f-10020ded5ad8 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:32.007658 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-76ed9de8-9dcf-4bd6-8279-afe0fa4f8e80 req-5daa656f-e0ac-4d23-b50f-10020ded5ad8 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:32.009249 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-76ed9de8-9dcf-4bd6-8279-afe0fa4f8e80 req-5daa656f-e0ac-4d23-b50f-10020ded5ad8 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:32.051668 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-76ed9de8-9dcf-4bd6-8279-afe0fa4f8e80 req-5daa656f-e0ac-4d23-b50f-10020ded5ad8 service nova] Creating event network-vif-deleted:f5ea5791-6357-48d5-bdaa-4b91eacc1a22 for instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa on hv-cinder-73126 Aug 29 19:13:32.057975 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-76ed9de8-9dcf-4bd6-8279-afe0fa4f8e80 req-5daa656f-e0ac-4d23-b50f-10020ded5ad8 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078662 Aug 29 19:13:32.059311 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 429/853] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:32.204321 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:32.205108 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:32.214417 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:32.229392 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:32.230370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:32.231425 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:32.232148 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:32.233317 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:32.262014 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-36b0e039-ff63-4a33-bb14-ea1ca7a7190b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:32.269763 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] HTTP exception thrown: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:13:32.277888 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-36b0e039-ff63-4a33-bb14-ea1ca7a7190b tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1366 microversion: 2.1 time: 0.317687 Aug 29 19:13:32.280248 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 425/854] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:31 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Request method failure captured: Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 HTTP/1.1 Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ71YeLhllOhg8guQ8tj9inO7z2Ff1bEPaTezjckEOz8mxTFOlLsAiMGkbcGE7RALOQsuhf9scRnjUvorTlzpcQwjpeV6BZCKbzaKKMs2sMan908NID2pDHb27klKWgE7-ciJIqsjJMNKwd6_asi-wq4lYlN5jchqp0_1c-Zq41FSjg Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 6a4d940594f542808602c7260993f85f Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-TestVolumeBootPattern-290515198 Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:13:32.281168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6a4d940594f542808602c7260993f85f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6a4d940594f542808602c7260993f85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6a4d940594f542808602c7260993f85f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6a4d940594f542808602c7260993f85f"}]}] Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-TestVolumeBootPattern-290515198 Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 6a4d940594f542808602c7260993f85f Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-TestVolumeBootPattern-290515198 Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-TestVolumeBootPattern-290515198-project Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 8f1c0b2189a041fdb8dbe2a0290ffac8 Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-TestVolumeBootPattern-290515198-project Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:13:32.282632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': 'b52e65bd-038e-4fc8-807e-4e4ce60c8db7'} Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:32.283588 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:13:32.285107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:32.286614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Returning 404 to user: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:32.287189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-18cfa029-495b-431d-93fe-b0d533694d63 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 404 len: 111 microversion: 2.1 time: 0.089350 Aug 29 19:13:32.298204 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 430/855] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:32 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:13:32.403593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-317186887", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1804926399", "security_groups": [{"name": "tempest-secgroup-smoke-805233569"}], "block_device_mapping_v2": [{"uuid": "8eb598a0-cad4-4aa5-9b9b-eb1fc5190f11", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e57e46be-ed2c-4b43-aa10-cfbdcaee4566"}]}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:32.419197 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:32.486031 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-01d52f61-2cf3-4181-970a-cc88de0a9d16 req-cbe6cf32-d58a-4cd4-b597-165df188ff1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e51834d-08d0-4905-9dfd-8ea77d2859e9", "tag": "30c4fffe-282d-4ca5-999f-190eabe30cfc"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:32.505586 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-01d52f61-2cf3-4181-970a-cc88de0a9d16 req-cbe6cf32-d58a-4cd4-b597-165df188ff1c service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:32.506078 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-01d52f61-2cf3-4181-970a-cc88de0a9d16 req-cbe6cf32-d58a-4cd4-b597-165df188ff1c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:32.506518 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-01d52f61-2cf3-4181-970a-cc88de0a9d16 req-cbe6cf32-d58a-4cd4-b597-165df188ff1c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:32.534133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:32.536459 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-01d52f61-2cf3-4181-970a-cc88de0a9d16 req-cbe6cf32-d58a-4cd4-b597-165df188ff1c service nova] Creating event network-changed:30c4fffe-282d-4ca5-999f-190eabe30cfc for instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 on hv-cinder-73126 Aug 29 19:13:32.541268 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-01d52f61-2cf3-4181-970a-cc88de0a9d16 req-cbe6cf32-d58a-4cd4-b597-165df188ff1c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061949 Aug 29 19:13:32.547243 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 431/856] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:32.564290 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.network.neutron [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] validate_networks() for [('e57e46be-ed2c-4b43-aa10-cfbdcaee4566', None, None, None, None, None)] {{(pid=115968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:13:32.747612 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:32.748756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:32.756829 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:32.757523 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:32.757969 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:32.758677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:32.759197 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:32.759893 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:32.796964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:32.796964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:32.797440 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:32.797905 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lazy-loading 'fault' on Instance uuid 0236f3d8-fe14-4ea6-a952-ad43a97260aa {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:13:32.862757 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:32.871191 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-0bd8dfcf-cde4-4ed4-a4a3-e236025699db tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 200 len: 1335 microversion: 2.1 time: 0.129036 Aug 29 19:13:32.871921 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 432/857] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:32 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 1335 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:33.030235 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Flavor limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:13:33.030695 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Image limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:13:33.031233 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Flavor pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:13:33.032091 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Image pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:13:33.032731 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:13:33.045439 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:33.046112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:33.046656 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:33.047533 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:33.048153 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:33.048646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:33.069994 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Getting quotas for project 6a4d940594f542808602c7260993f85f. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:13:33.074829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Getting quotas for user 8f1c0b2189a041fdb8dbe2a0290ffac8 and project 6a4d940594f542808602c7260993f85f. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:13:33.143200 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Going to run 1 instances... {{(pid=115968) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:13:33.145486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8eb598a0-cad4-4aa5-9b9b-eb1fc5190f11',volume_size=None,volume_type=None)] {{(pid=115968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:13:33.303040 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c5291bec-0cb8-4f08-8144-b61da0db750e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:33.303789 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c5291bec-0cb8-4f08-8144-b61da0db750e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:33.306118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-dc6af063-66b1-493a-aa7a-d45587a7471a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.906403 Aug 29 19:13:33.306767 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 426/858] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:13:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:13:33.316212 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c5291bec-0cb8-4f08-8144-b61da0db750e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:33.316961 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c5291bec-0cb8-4f08-8144-b61da0db750e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:33.317648 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c5291bec-0cb8-4f08-8144-b61da0db750e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:33.318621 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c5291bec-0cb8-4f08-8144-b61da0db750e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:33.319387 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c5291bec-0cb8-4f08-8144-b61da0db750e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:33.319921 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c5291bec-0cb8-4f08-8144-b61da0db750e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:33.327495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5db29c02-25f9-4d1e-aea4-29a567132e13 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:33.329322 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5db29c02-25f9-4d1e-aea4-29a567132e13 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:33.422755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5db29c02-25f9-4d1e-aea4-29a567132e13 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:33.430551 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5db29c02-25f9-4d1e-aea4-29a567132e13 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1094 microversion: 2.1 time: 0.116725 Aug 29 19:13:33.431633 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 427/859] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:33 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1094 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:33.501279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c5291bec-0cb8-4f08-8144-b61da0db750e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:33.509367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c5291bec-0cb8-4f08-8144-b61da0db750e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1366 microversion: 2.1 time: 0.211219 Aug 29 19:13:33.510079 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 433/860] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:33 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:33.893243 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:33.893849 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0236f3d8-fe14-4ea6-a952-ad43a97260aa] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:33.899872 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:33.900354 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:33.900789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:33.901470 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:33.901918 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:33.902337 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:33.916080 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] HTTP exception thrown: Instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa could not be found. Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Request method failure captured: Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa HTTP/1.1 Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6E5qq19XpHwlOHkTbjyma9QlFTrqFt7b9-twpMAOXdQdC0jV3pWUGE_MXRfTm_NQ3UnXuJjxiqQl_lHPtfUSarmRjbywIggIk9H_6vW-4_SeCMX7AMBMSIiCdM2J_TOMs4lmb3ACxn7AXkq0BEDSHTDmoEaY1zLgOYRdtjW6wZifc Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: b429eb37f4ed408d830ef2c1034e9bdc Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:13:33.917672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b429eb37f4ed408d830ef2c1034e9bdc"}]}] Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: b429eb37f4ed408d830ef2c1034e9bdc Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-ServerRescueNegativeTestJSON-1171381257-project Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 73c4a7ab7fc7425389843798faa25372 Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1171381257-project Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa could not be found. Aug 29 19:13:33.919509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '0236f3d8-fe14-4ea6-a952-ad43a97260aa'} Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa could not be found. Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:33.920625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa could not be found. Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa could not be found. Aug 29 19:13:33.922063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:13:33.923464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Returning 404 to user: Instance 0236f3d8-fe14-4ea6-a952-ad43a97260aa could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:33.923464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ba72af11-cd65-4ba5-b54e-41a548610e32 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa" status: 404 len: 111 microversion: 2.1 time: 0.030545 Aug 29 19:13:33.923464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 428/861] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:33 2022] GET /compute/v2.1/servers/0236f3d8-fe14-4ea6-a952-ad43a97260aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:13:33.928265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b4786f80-358c-4504-baa3-dfcf684a7352 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '.version_select at 0x7f3d76345310>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:33.946538 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b4786f80-358c-4504-baa3-dfcf684a7352 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985167894" status: 202 len: 0 microversion: 2.1 time: 0.022204 Aug 29 19:13:33.947168 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 434/862] 10.222.0.94 () {58 vars in 1221 bytes} [Mon Aug 29 19:13:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985167894 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:13:34.454949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0c73d84a-7c93-4467-a480-3f191d856a4d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:34.455748 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0c73d84a-7c93-4467-a480-3f191d856a4d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:34.463398 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c73d84a-7c93-4467-a480-3f191d856a4d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:34.464209 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c73d84a-7c93-4467-a480-3f191d856a4d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:34.465034 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c73d84a-7c93-4467-a480-3f191d856a4d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:34.466020 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c73d84a-7c93-4467-a480-3f191d856a4d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:34.466881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c73d84a-7c93-4467-a480-3f191d856a4d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:34.467360 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0c73d84a-7c93-4467-a480-3f191d856a4d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:34.530167 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2000f301-48a3-403c-8c4e-d36349d3777a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:34.531019 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2000f301-48a3-403c-8c4e-d36349d3777a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:34.544063 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2000f301-48a3-403c-8c4e-d36349d3777a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:34.545334 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2000f301-48a3-403c-8c4e-d36349d3777a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:34.545831 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2000f301-48a3-403c-8c4e-d36349d3777a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:34.546753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2000f301-48a3-403c-8c4e-d36349d3777a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:34.547236 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2000f301-48a3-403c-8c4e-d36349d3777a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:34.547669 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2000f301-48a3-403c-8c4e-d36349d3777a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:34.554637 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0c73d84a-7c93-4467-a480-3f191d856a4d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:34.565832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0c73d84a-7c93-4467-a480-3f191d856a4d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1136 microversion: 2.1 time: 0.116028 Aug 29 19:13:34.566547 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 429/863] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:34 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1136 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:34.710884 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2000f301-48a3-403c-8c4e-d36349d3777a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:34.719945 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2000f301-48a3-403c-8c4e-d36349d3777a tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1366 microversion: 2.1 time: 0.193989 Aug 29 19:13:34.720614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 435/864] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:34 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:35.594847 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-409dc633-f956-4e47-bc0e-385741729934 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:35.595613 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-409dc633-f956-4e47-bc0e-385741729934 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:35.602210 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-409dc633-f956-4e47-bc0e-385741729934 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:35.602705 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-409dc633-f956-4e47-bc0e-385741729934 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:35.603510 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-409dc633-f956-4e47-bc0e-385741729934 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:35.603872 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-409dc633-f956-4e47-bc0e-385741729934 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:35.604327 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-409dc633-f956-4e47-bc0e-385741729934 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:35.604751 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-409dc633-f956-4e47-bc0e-385741729934 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:35.674260 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-409dc633-f956-4e47-bc0e-385741729934 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:35.685576 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-409dc633-f956-4e47-bc0e-385741729934 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1210 microversion: 2.1 time: 0.094628 Aug 29 19:13:35.686328 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 430/865] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:35 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:35.741551 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fa4f8923-48ae-46dc-8537-8ddf04b978da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:35.742233 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fa4f8923-48ae-46dc-8537-8ddf04b978da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:35.744927 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:35.745607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=6 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:35.752141 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa4f8923-48ae-46dc-8537-8ddf04b978da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:35.753102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa4f8923-48ae-46dc-8537-8ddf04b978da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:35.753760 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa4f8923-48ae-46dc-8537-8ddf04b978da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:35.754664 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa4f8923-48ae-46dc-8537-8ddf04b978da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:35.755508 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa4f8923-48ae-46dc-8537-8ddf04b978da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:35.755924 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa4f8923-48ae-46dc-8537-8ddf04b978da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:35.919363 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fa4f8923-48ae-46dc-8537-8ddf04b978da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:35.933084 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fa4f8923-48ae-46dc-8537-8ddf04b978da tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1366 microversion: 2.1 time: 0.196032 Aug 29 19:13:35.934462 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 436/866] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:35 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:36.706594 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-917e6761-fb97-454c-a23e-a76bb1e775d5 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:36.707283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-917e6761-fb97-454c-a23e-a76bb1e775d5 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:36.714127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-917e6761-fb97-454c-a23e-a76bb1e775d5 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:36.714525 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-917e6761-fb97-454c-a23e-a76bb1e775d5 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:36.714957 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-917e6761-fb97-454c-a23e-a76bb1e775d5 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:36.715671 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-917e6761-fb97-454c-a23e-a76bb1e775d5 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:36.716119 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-917e6761-fb97-454c-a23e-a76bb1e775d5 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:36.716533 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-917e6761-fb97-454c-a23e-a76bb1e775d5 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:36.721542 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:36.863669 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-917e6761-fb97-454c-a23e-a76bb1e775d5 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:36.868445 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-127b9ff0-02ef-4724-ab78-5e0759e6b686 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:36.869637 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-127b9ff0-02ef-4724-ab78-5e0759e6b686 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:36.872773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-917e6761-fb97-454c-a23e-a76bb1e775d5 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1265 microversion: 2.1 time: 0.170074 Aug 29 19:13:36.883375 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 431/867] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:36 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:36.883375 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-632e34ce-c962-4575-9270-a699e76a8b71 req-5d39dcfe-397a-4f10-8091-1a0983a4b358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b9dcd0-904c-434b-880c-a80e86c01055", "tag": "adcd197a-d293-4fcc-aa1a-bea1781ba4dc"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:36.892286 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-127b9ff0-02ef-4724-ab78-5e0759e6b686 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:36.893097 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-127b9ff0-02ef-4724-ab78-5e0759e6b686 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:36.893778 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-127b9ff0-02ef-4724-ab78-5e0759e6b686 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:36.894979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-127b9ff0-02ef-4724-ab78-5e0759e6b686 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:36.895661 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-127b9ff0-02ef-4724-ab78-5e0759e6b686 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:36.896294 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-127b9ff0-02ef-4724-ab78-5e0759e6b686 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:36.896846 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-632e34ce-c962-4575-9270-a699e76a8b71 req-5d39dcfe-397a-4f10-8091-1a0983a4b358 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:36.897552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-632e34ce-c962-4575-9270-a699e76a8b71 req-5d39dcfe-397a-4f10-8091-1a0983a4b358 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:36.898711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-632e34ce-c962-4575-9270-a699e76a8b71 req-5d39dcfe-397a-4f10-8091-1a0983a4b358 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:36.911805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-632e34ce-c962-4575-9270-a699e76a8b71 req-5d39dcfe-397a-4f10-8091-1a0983a4b358 service nova] Creating event network-changed:adcd197a-d293-4fcc-aa1a-bea1781ba4dc for instance 79b9dcd0-904c-434b-880c-a80e86c01055 on hv-cinder-73126 Aug 29 19:13:36.919249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-632e34ce-c962-4575-9270-a699e76a8b71 req-5d39dcfe-397a-4f10-8091-1a0983a4b358 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041040 Aug 29 19:13:36.921166 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 432/868] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:36.927863 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-127b9ff0-02ef-4724-ab78-5e0759e6b686 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:13:36.955450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e303a7a9-e002-4cea-962c-522bdbe7ff96 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:36.956179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e303a7a9-e002-4cea-962c-522bdbe7ff96 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:36.962655 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e303a7a9-e002-4cea-962c-522bdbe7ff96 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:36.963236 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e303a7a9-e002-4cea-962c-522bdbe7ff96 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:36.963680 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e303a7a9-e002-4cea-962c-522bdbe7ff96 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:36.964442 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e303a7a9-e002-4cea-962c-522bdbe7ff96 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:36.964829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e303a7a9-e002-4cea-962c-522bdbe7ff96 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:36.965243 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e303a7a9-e002-4cea-962c-522bdbe7ff96 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:37.011031 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-127b9ff0-02ef-4724-ab78-5e0759e6b686 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "DELETE /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 204 len: 0 microversion: 2.1 time: 0.146501 Aug 29 19:13:37.011766 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 437/869] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:13:36 2022] DELETE /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:13:37.021196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-efcbe617-ce91-4103-a793-534b2d13e033 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:37.021899 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-efcbe617-ce91-4103-a793-534b2d13e033 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:37.028181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-efcbe617-ce91-4103-a793-534b2d13e033 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:37.028679 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-efcbe617-ce91-4103-a793-534b2d13e033 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:37.029110 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-efcbe617-ce91-4103-a793-534b2d13e033 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:37.030028 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-efcbe617-ce91-4103-a793-534b2d13e033 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:37.030476 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-efcbe617-ce91-4103-a793-534b2d13e033 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:37.030905 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-efcbe617-ce91-4103-a793-534b2d13e033 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:37.166971 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e303a7a9-e002-4cea-962c-522bdbe7ff96 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:37.175147 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e303a7a9-e002-4cea-962c-522bdbe7ff96 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1366 microversion: 2.1 time: 0.224854 Aug 29 19:13:37.175736 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 433/870] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:36 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:37.194625 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-efcbe617-ce91-4103-a793-534b2d13e033 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:37.203215 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-efcbe617-ce91-4103-a793-534b2d13e033 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1507 microversion: 2.1 time: 0.186390 Aug 29 19:13:37.203789 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 438/871] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:37 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:37.896112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-33927845-79aa-4c63-8f15-0302ec663299 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:37.896720 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-33927845-79aa-4c63-8f15-0302ec663299 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:37.903107 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33927845-79aa-4c63-8f15-0302ec663299 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:37.903597 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33927845-79aa-4c63-8f15-0302ec663299 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:37.904037 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33927845-79aa-4c63-8f15-0302ec663299 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:37.905004 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33927845-79aa-4c63-8f15-0302ec663299 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:37.905469 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33927845-79aa-4c63-8f15-0302ec663299 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:37.905895 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33927845-79aa-4c63-8f15-0302ec663299 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:37.982729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-f73ff6d1-5f9f-470c-b43a-ef7f6c7ed784 req-1983de32-1bca-48bf-b664-913e27808aca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e51834d-08d0-4905-9dfd-8ea77d2859e9", "name": "network-vif-plugged", "status": "completed", "tag": "30c4fffe-282d-4ca5-999f-190eabe30cfc"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:37.992568 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-f73ff6d1-5f9f-470c-b43a-ef7f6c7ed784 req-1983de32-1bca-48bf-b664-913e27808aca service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:37.993057 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-f73ff6d1-5f9f-470c-b43a-ef7f6c7ed784 req-1983de32-1bca-48bf-b664-913e27808aca service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:37.993495 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-f73ff6d1-5f9f-470c-b43a-ef7f6c7ed784 req-1983de32-1bca-48bf-b664-913e27808aca service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:38.004986 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-f73ff6d1-5f9f-470c-b43a-ef7f6c7ed784 req-1983de32-1bca-48bf-b664-913e27808aca service nova] Creating event network-vif-plugged:30c4fffe-282d-4ca5-999f-190eabe30cfc for instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 on hv-cinder-73126 Aug 29 19:13:38.010363 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-f73ff6d1-5f9f-470c-b43a-ef7f6c7ed784 req-1983de32-1bca-48bf-b664-913e27808aca service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097450 Aug 29 19:13:38.010671 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 439/872] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:13:38.046486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-33927845-79aa-4c63-8f15-0302ec663299 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:38.054102 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-33927845-79aa-4c63-8f15-0302ec663299 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1265 microversion: 2.1 time: 0.161824 Aug 29 19:13:38.054662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 434/873] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:37 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:38.197568 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8fd09978-75d8-421e-880b-b9cb288892c9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:38.198287 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8fd09978-75d8-421e-880b-b9cb288892c9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:38.204912 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8fd09978-75d8-421e-880b-b9cb288892c9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:38.205472 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8fd09978-75d8-421e-880b-b9cb288892c9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:38.205904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8fd09978-75d8-421e-880b-b9cb288892c9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:38.206587 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8fd09978-75d8-421e-880b-b9cb288892c9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:38.207037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8fd09978-75d8-421e-880b-b9cb288892c9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:38.207478 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8fd09978-75d8-421e-880b-b9cb288892c9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:38.224163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ae218a72-dc38-4a37-9d98-a02d5bc33669 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:38.224775 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ae218a72-dc38-4a37-9d98-a02d5bc33669 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:38.230632 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ae218a72-dc38-4a37-9d98-a02d5bc33669 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:38.231528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ae218a72-dc38-4a37-9d98-a02d5bc33669 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:38.231665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ae218a72-dc38-4a37-9d98-a02d5bc33669 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:38.232293 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ae218a72-dc38-4a37-9d98-a02d5bc33669 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:38.232754 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ae218a72-dc38-4a37-9d98-a02d5bc33669 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:38.233669 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ae218a72-dc38-4a37-9d98-a02d5bc33669 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:38.403785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8fd09978-75d8-421e-880b-b9cb288892c9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:38.411176 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ae218a72-dc38-4a37-9d98-a02d5bc33669 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:38.411438 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8fd09978-75d8-421e-880b-b9cb288892c9 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1366 microversion: 2.1 time: 0.218022 Aug 29 19:13:38.412040 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 440/874] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:38 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:38.419049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ae218a72-dc38-4a37-9d98-a02d5bc33669 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1507 microversion: 2.1 time: 0.198751 Aug 29 19:13:38.419631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 435/875] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:38 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:39.077353 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bdb92cfc-99d9-4c55-a887-dd55f2755512 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:39.078120 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bdb92cfc-99d9-4c55-a887-dd55f2755512 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:39.084625 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bdb92cfc-99d9-4c55-a887-dd55f2755512 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:39.085110 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bdb92cfc-99d9-4c55-a887-dd55f2755512 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:39.085546 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bdb92cfc-99d9-4c55-a887-dd55f2755512 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:39.086238 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bdb92cfc-99d9-4c55-a887-dd55f2755512 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:39.086692 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bdb92cfc-99d9-4c55-a887-dd55f2755512 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:39.087142 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bdb92cfc-99d9-4c55-a887-dd55f2755512 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:39.432753 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-61ea0170-36b4-44c4-94d3-6f81e2522573 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:39.434932 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-61ea0170-36b4-44c4-94d3-6f81e2522573 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:39.440706 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61ea0170-36b4-44c4-94d3-6f81e2522573 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:39.441185 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61ea0170-36b4-44c4-94d3-6f81e2522573 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:39.441618 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61ea0170-36b4-44c4-94d3-6f81e2522573 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:39.442314 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61ea0170-36b4-44c4-94d3-6f81e2522573 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:39.442781 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61ea0170-36b4-44c4-94d3-6f81e2522573 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:39.443227 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-61ea0170-36b4-44c4-94d3-6f81e2522573 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:39.631908 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-bdb92cfc-99d9-4c55-a887-dd55f2755512 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:39.640113 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bdb92cfc-99d9-4c55-a887-dd55f2755512 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1265 microversion: 2.1 time: 0.568490 Aug 29 19:13:39.640826 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 441/876] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:39 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1265 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:39.645494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3d540026-d84a-4799-96ce-12ad5ab5fee3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:39.645877 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3d540026-d84a-4799-96ce-12ad5ab5fee3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:39.651756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d540026-d84a-4799-96ce-12ad5ab5fee3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:39.652318 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d540026-d84a-4799-96ce-12ad5ab5fee3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:39.652823 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d540026-d84a-4799-96ce-12ad5ab5fee3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:39.653584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d540026-d84a-4799-96ce-12ad5ab5fee3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:39.654127 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d540026-d84a-4799-96ce-12ad5ab5fee3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:39.655318 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3d540026-d84a-4799-96ce-12ad5ab5fee3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:39.716863 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-61ea0170-36b4-44c4-94d3-6f81e2522573 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:39.725031 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-61ea0170-36b4-44c4-94d3-6f81e2522573 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1366 microversion: 2.1 time: 0.296237 Aug 29 19:13:39.725700 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 436/877] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:39 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:39.868159 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3d540026-d84a-4799-96ce-12ad5ab5fee3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:39.877317 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3d540026-d84a-4799-96ce-12ad5ab5fee3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1507 microversion: 2.1 time: 0.235479 Aug 29 19:13:39.877904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 442/878] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:39 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:40.027855 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-6e6b656e-e312-4f2a-a7ca-b93f31a973fd req-cee687cf-92c2-4b5a-9dc7-d98569063260 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0792b7a2-491c-41dc-b356-6116396636b7", "name": "network-vif-deleted", "tag": "2773a328-c32b-4251-884e-1d7401f1853a"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:40.037942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-6e6b656e-e312-4f2a-a7ca-b93f31a973fd req-cee687cf-92c2-4b5a-9dc7-d98569063260 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:40.038512 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-6e6b656e-e312-4f2a-a7ca-b93f31a973fd req-cee687cf-92c2-4b5a-9dc7-d98569063260 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:40.039012 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-6e6b656e-e312-4f2a-a7ca-b93f31a973fd req-cee687cf-92c2-4b5a-9dc7-d98569063260 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:40.051627 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-6e6b656e-e312-4f2a-a7ca-b93f31a973fd req-cee687cf-92c2-4b5a-9dc7-d98569063260 service nova] Creating event network-vif-deleted:2773a328-c32b-4251-884e-1d7401f1853a for instance 0792b7a2-491c-41dc-b356-6116396636b7 on hv-cinder-73126 Aug 29 19:13:40.056497 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-6e6b656e-e312-4f2a-a7ca-b93f31a973fd req-cee687cf-92c2-4b5a-9dc7-d98569063260 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032344 Aug 29 19:13:40.057749 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 437/879] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:40.661969 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cd8bcc3d-0427-4adc-9a7b-44255e92c19f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:40.662577 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cd8bcc3d-0427-4adc-9a7b-44255e92c19f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:40.669301 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd8bcc3d-0427-4adc-9a7b-44255e92c19f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:40.669787 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd8bcc3d-0427-4adc-9a7b-44255e92c19f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:40.670223 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd8bcc3d-0427-4adc-9a7b-44255e92c19f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:40.671008 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd8bcc3d-0427-4adc-9a7b-44255e92c19f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:40.671555 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd8bcc3d-0427-4adc-9a7b-44255e92c19f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:40.671981 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cd8bcc3d-0427-4adc-9a7b-44255e92c19f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:40.746849 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-26b76bc4-5f6c-4ba7-914d-4dc4270b2f25 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:40.747563 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-26b76bc4-5f6c-4ba7-914d-4dc4270b2f25 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:40.754474 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26b76bc4-5f6c-4ba7-914d-4dc4270b2f25 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:40.754957 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26b76bc4-5f6c-4ba7-914d-4dc4270b2f25 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:40.755418 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26b76bc4-5f6c-4ba7-914d-4dc4270b2f25 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:40.756112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26b76bc4-5f6c-4ba7-914d-4dc4270b2f25 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:40.756569 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26b76bc4-5f6c-4ba7-914d-4dc4270b2f25 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:40.756989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26b76bc4-5f6c-4ba7-914d-4dc4270b2f25 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:40.815634 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cd8bcc3d-0427-4adc-9a7b-44255e92c19f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:40.823305 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cd8bcc3d-0427-4adc-9a7b-44255e92c19f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1265 microversion: 2.1 time: 0.165151 Aug 29 19:13:40.823871 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 443/880] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:40 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:40.896949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-26b76bc4-5f6c-4ba7-914d-4dc4270b2f25 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:40.898440 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:40.899247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:40.904959 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-26b76bc4-5f6c-4ba7-914d-4dc4270b2f25 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1366 microversion: 2.1 time: 0.162807 Aug 29 19:13:40.905410 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:40.906453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 438/881] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:40 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:40.906614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:40.906614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:40.907285 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:40.907751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:40.908184 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:40.939858 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:40.940264 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:40.940705 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:40.941149 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lazy-loading 'fault' on Instance uuid 0792b7a2-491c-41dc-b356-6116396636b7 {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:13:40.984461 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:40.992230 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c0e5db71-31bc-4862-8f60-91c938193920 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1311 microversion: 2.1 time: 0.098328 Aug 29 19:13:40.992806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 444/882] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:40 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:41.845895 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-131868cb-d951-4ba9-a41b-08b33c224e91 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:41.847399 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-131868cb-d951-4ba9-a41b-08b33c224e91 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:41.854684 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-131868cb-d951-4ba9-a41b-08b33c224e91 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:41.855493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-131868cb-d951-4ba9-a41b-08b33c224e91 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:41.855650 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-131868cb-d951-4ba9-a41b-08b33c224e91 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:41.856551 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-131868cb-d951-4ba9-a41b-08b33c224e91 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:41.857169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-131868cb-d951-4ba9-a41b-08b33c224e91 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:41.857750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-131868cb-d951-4ba9-a41b-08b33c224e91 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:41.926197 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d184e14f-11ec-4864-b73a-41a5cf0e4e22 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:41.927592 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d184e14f-11ec-4864-b73a-41a5cf0e4e22 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:41.935007 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d184e14f-11ec-4864-b73a-41a5cf0e4e22 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:41.936348 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d184e14f-11ec-4864-b73a-41a5cf0e4e22 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:41.937367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d184e14f-11ec-4864-b73a-41a5cf0e4e22 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:41.938337 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d184e14f-11ec-4864-b73a-41a5cf0e4e22 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:41.940080 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d184e14f-11ec-4864-b73a-41a5cf0e4e22 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:41.942137 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d184e14f-11ec-4864-b73a-41a5cf0e4e22 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:42.150809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-131868cb-d951-4ba9-a41b-08b33c224e91 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:42.158943 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-131868cb-d951-4ba9-a41b-08b33c224e91 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1265 microversion: 2.1 time: 0.317764 Aug 29 19:13:42.159576 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 439/883] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:41 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1265 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:42.163980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:42.164573 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:42.172728 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d184e14f-11ec-4864-b73a-41a5cf0e4e22 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:42.177092 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:42.177662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:42.178174 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:42.178914 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:42.179413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:42.179911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:42.180419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d184e14f-11ec-4864-b73a-41a5cf0e4e22 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1556 microversion: 2.1 time: 0.258370 Aug 29 19:13:42.180978 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 445/884] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:41 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1556 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:42.201373 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-66f5c611-b4e9-4b52-b76f-33693881a7a6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:42.201861 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-66f5c611-b4e9-4b52-b76f-33693881a7a6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:42.207970 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66f5c611-b4e9-4b52-b76f-33693881a7a6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:42.208460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66f5c611-b4e9-4b52-b76f-33693881a7a6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:42.208898 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66f5c611-b4e9-4b52-b76f-33693881a7a6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:42.209597 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66f5c611-b4e9-4b52-b76f-33693881a7a6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:42.210055 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66f5c611-b4e9-4b52-b76f-33693881a7a6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:42.210483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-66f5c611-b4e9-4b52-b76f-33693881a7a6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:42.211773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:42.212263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:42.212702 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:42.213154 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lazy-loading 'fault' on Instance uuid 0792b7a2-491c-41dc-b356-6116396636b7 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:13:42.263964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:42.271860 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9c7ea57a-6d12-4401-9526-cadf41984d59 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 200 len: 1311 microversion: 2.1 time: 0.111293 Aug 29 19:13:42.272506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 440/885] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:42 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:42.358303 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-66f5c611-b4e9-4b52-b76f-33693881a7a6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160050 Aug 29 19:13:42.359567 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 446/886] 10.222.0.94 () {58 vars in 1275 bytes} [Mon Aug 29 19:13:42 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:13:43.180782 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-03a31b96-0bd7-45fa-a0ac-cc940fb8280a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:43.181373 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-03a31b96-0bd7-45fa-a0ac-cc940fb8280a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:43.184643 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:43.190359 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03a31b96-0bd7-45fa-a0ac-cc940fb8280a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:43.190865 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03a31b96-0bd7-45fa-a0ac-cc940fb8280a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:43.191340 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03a31b96-0bd7-45fa-a0ac-cc940fb8280a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:43.192054 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03a31b96-0bd7-45fa-a0ac-cc940fb8280a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:43.192519 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03a31b96-0bd7-45fa-a0ac-cc940fb8280a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:43.192951 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03a31b96-0bd7-45fa-a0ac-cc940fb8280a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:43.294414 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:43.295153 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: 0792b7a2-491c-41dc-b356-6116396636b7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:43.303920 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:43.304425 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:43.304861 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:43.305569 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:43.306029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:43.306455 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:43.321902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] HTTP exception thrown: Instance 0792b7a2-491c-41dc-b356-6116396636b7 could not be found. Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Request method failure captured: Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 HTTP/1.1 Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6E5qq19XpHwlOHkTbjyma9QlFTrqFt7b9-twpMAOXdQdC0jV3pWUGE_MXRfTm_NQ3UnXuJjxiqQl_lHPtfUSarmRjbywIggIk9H_6vW-4_SeCMX7AMBMSIiCdM2J_TOMs4lmb3ACxn7AXkq0BEDSHTDmoEaY1zLgOYRdtjW6wZifc Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: b429eb37f4ed408d830ef2c1034e9bdc Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:13:43.323607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b429eb37f4ed408d830ef2c1034e9bdc"}]}] Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: b429eb37f4ed408d830ef2c1034e9bdc Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-ServerRescueNegativeTestJSON-1171381257-project Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 73c4a7ab7fc7425389843798faa25372 Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1171381257-project Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 0792b7a2-491c-41dc-b356-6116396636b7 could not be found. Aug 29 19:13:43.324926 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '0792b7a2-491c-41dc-b356-6116396636b7'} Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0792b7a2-491c-41dc-b356-6116396636b7 could not be found. Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:43.329481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0792b7a2-491c-41dc-b356-6116396636b7 could not be found. Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0792b7a2-491c-41dc-b356-6116396636b7 could not be found. Aug 29 19:13:43.330783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:43.331970 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Returning 404 to user: Instance 0792b7a2-491c-41dc-b356-6116396636b7 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:43.331970 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-dc8064ed-b796-4ea0-be98-23aee541ba16 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7" status: 404 len: 111 microversion: 2.1 time: 0.035454 Aug 29 19:13:43.331970 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 447/887] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:43 2022] GET /compute/v2.1/servers/0792b7a2-491c-41dc-b356-6116396636b7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:13:43.334710 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7aa81388-13f5-4ef2-b285-95461f265f9d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:43.335248 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7aa81388-13f5-4ef2-b285-95461f265f9d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:43.339613 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-03a31b96-0bd7-45fa-a0ac-cc940fb8280a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:43.342037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7aa81388-13f5-4ef2-b285-95461f265f9d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:43.342614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7aa81388-13f5-4ef2-b285-95461f265f9d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:43.343297 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7aa81388-13f5-4ef2-b285-95461f265f9d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:43.344962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7aa81388-13f5-4ef2-b285-95461f265f9d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:43.345418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7aa81388-13f5-4ef2-b285-95461f265f9d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:43.346042 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7aa81388-13f5-4ef2-b285-95461f265f9d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:43.349372 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-03a31b96-0bd7-45fa-a0ac-cc940fb8280a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1265 microversion: 2.1 time: 0.172504 Aug 29 19:13:43.351873 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 441/888] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:43 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:43.379829 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7aa81388-13f5-4ef2-b285-95461f265f9d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:13:43.382723 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:43.464828 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7aa81388-13f5-4ef2-b285-95461f265f9d tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "DELETE /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 204 len: 0 microversion: 2.1 time: 0.133459 Aug 29 19:13:43.465774 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 448/889] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:13:43 2022] DELETE /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:13:43.475220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f66f4f6f-704f-47a3-87b3-e412cf3af2c3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:43.475828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f66f4f6f-704f-47a3-87b3-e412cf3af2c3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:43.478758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=14 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:43.482477 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f66f4f6f-704f-47a3-87b3-e412cf3af2c3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:43.482960 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f66f4f6f-704f-47a3-87b3-e412cf3af2c3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:43.483425 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f66f4f6f-704f-47a3-87b3-e412cf3af2c3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:43.484115 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f66f4f6f-704f-47a3-87b3-e412cf3af2c3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:43.484616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f66f4f6f-704f-47a3-87b3-e412cf3af2c3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:43.485361 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f66f4f6f-704f-47a3-87b3-e412cf3af2c3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:43.570806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-cdbaf884-ae28-4af7-b22d-8891f669f4e7 req-5baa5a91-8b0c-481f-9368-d7fbaad38b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e51834d-08d0-4905-9dfd-8ea77d2859e9", "tag": "30c4fffe-282d-4ca5-999f-190eabe30cfc"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:43.581170 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-cdbaf884-ae28-4af7-b22d-8891f669f4e7 req-5baa5a91-8b0c-481f-9368-d7fbaad38b83 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:43.581659 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-cdbaf884-ae28-4af7-b22d-8891f669f4e7 req-5baa5a91-8b0c-481f-9368-d7fbaad38b83 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:43.582093 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-cdbaf884-ae28-4af7-b22d-8891f669f4e7 req-5baa5a91-8b0c-481f-9368-d7fbaad38b83 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:43.593704 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-cdbaf884-ae28-4af7-b22d-8891f669f4e7 req-5baa5a91-8b0c-481f-9368-d7fbaad38b83 service nova] Creating event network-changed:30c4fffe-282d-4ca5-999f-190eabe30cfc for instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 on hv-cinder-73126 Aug 29 19:13:43.599754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-cdbaf884-ae28-4af7-b22d-8891f669f4e7 req-5baa5a91-8b0c-481f-9368-d7fbaad38b83 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032828 Aug 29 19:13:43.600677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 449/890] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:43.631813 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f66f4f6f-704f-47a3-87b3-e412cf3af2c3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:43.640362 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f66f4f6f-704f-47a3-87b3-e412cf3af2c3 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.169250 Aug 29 19:13:43.641498 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 442/891] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:43 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:43.966882 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-b2d9ba5d-9e55-42e9-a15f-0edb2a0aade2 req-e6837c6b-c47d-4600-9877-bccf4e86dd9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b9dcd0-904c-434b-880c-a80e86c01055", "name": "network-vif-plugged", "status": "completed", "tag": "adcd197a-d293-4fcc-aa1a-bea1781ba4dc"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:43.978293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-b2d9ba5d-9e55-42e9-a15f-0edb2a0aade2 req-e6837c6b-c47d-4600-9877-bccf4e86dd9f service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:43.978889 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-b2d9ba5d-9e55-42e9-a15f-0edb2a0aade2 req-e6837c6b-c47d-4600-9877-bccf4e86dd9f service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:43.979449 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-b2d9ba5d-9e55-42e9-a15f-0edb2a0aade2 req-e6837c6b-c47d-4600-9877-bccf4e86dd9f service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:43.991672 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-b2d9ba5d-9e55-42e9-a15f-0edb2a0aade2 req-e6837c6b-c47d-4600-9877-bccf4e86dd9f service nova] Creating event network-vif-plugged:adcd197a-d293-4fcc-aa1a-bea1781ba4dc for instance 79b9dcd0-904c-434b-880c-a80e86c01055 on hv-cinder-73126 Aug 29 19:13:43.997192 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-b2d9ba5d-9e55-42e9-a15f-0edb2a0aade2 req-e6837c6b-c47d-4600-9877-bccf4e86dd9f service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034332 Aug 29 19:13:43.998157 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 450/892] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:44.369976 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8b973f2d-dafb-4a16-baea-7fdf25a3e410 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:44.370713 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8b973f2d-dafb-4a16-baea-7fdf25a3e410 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:44.377811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b973f2d-dafb-4a16-baea-7fdf25a3e410 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:44.378317 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b973f2d-dafb-4a16-baea-7fdf25a3e410 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:44.378771 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b973f2d-dafb-4a16-baea-7fdf25a3e410 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:44.379501 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b973f2d-dafb-4a16-baea-7fdf25a3e410 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:44.379964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b973f2d-dafb-4a16-baea-7fdf25a3e410 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:44.380394 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8b973f2d-dafb-4a16-baea-7fdf25a3e410 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:44.520685 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-8b973f2d-dafb-4a16-baea-7fdf25a3e410 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:44.528940 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8b973f2d-dafb-4a16-baea-7fdf25a3e410 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1265 microversion: 2.1 time: 0.162882 Aug 29 19:13:44.529607 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 443/893] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:44 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:44.663042 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1d399dcb-2bec-4114-a9cf-2a68f89258b7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:44.663761 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1d399dcb-2bec-4114-a9cf-2a68f89258b7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:44.670102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d399dcb-2bec-4114-a9cf-2a68f89258b7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:44.670610 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d399dcb-2bec-4114-a9cf-2a68f89258b7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:44.671041 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d399dcb-2bec-4114-a9cf-2a68f89258b7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:44.671757 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d399dcb-2bec-4114-a9cf-2a68f89258b7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:44.672870 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d399dcb-2bec-4114-a9cf-2a68f89258b7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:44.673305 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1d399dcb-2bec-4114-a9cf-2a68f89258b7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:44.809668 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1d399dcb-2bec-4114-a9cf-2a68f89258b7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:44.818359 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1d399dcb-2bec-4114-a9cf-2a68f89258b7 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.160007 Aug 29 19:13:44.819326 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 451/894] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:44 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:45.551392 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-de2238be-1e33-4ea3-925f-15fde45c0082 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:45.552011 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-de2238be-1e33-4ea3-925f-15fde45c0082 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:45.558848 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-de2238be-1e33-4ea3-925f-15fde45c0082 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:45.559414 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-de2238be-1e33-4ea3-925f-15fde45c0082 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:45.559851 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-de2238be-1e33-4ea3-925f-15fde45c0082 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:45.560546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-de2238be-1e33-4ea3-925f-15fde45c0082 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:45.561002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-de2238be-1e33-4ea3-925f-15fde45c0082 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:45.561426 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-de2238be-1e33-4ea3-925f-15fde45c0082 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:45.696318 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-de2238be-1e33-4ea3-925f-15fde45c0082 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:45.704106 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-de2238be-1e33-4ea3-925f-15fde45c0082 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1265 microversion: 2.1 time: 0.157202 Aug 29 19:13:45.704670 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 444/895] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:45 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:45.839001 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b6d505d2-b1b6-4a2a-9312-6e660e11bdb1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:45.839645 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b6d505d2-b1b6-4a2a-9312-6e660e11bdb1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:45.846257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6d505d2-b1b6-4a2a-9312-6e660e11bdb1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:45.846740 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6d505d2-b1b6-4a2a-9312-6e660e11bdb1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:45.847202 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6d505d2-b1b6-4a2a-9312-6e660e11bdb1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:45.847896 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6d505d2-b1b6-4a2a-9312-6e660e11bdb1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:45.848386 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6d505d2-b1b6-4a2a-9312-6e660e11bdb1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:45.848807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6d505d2-b1b6-4a2a-9312-6e660e11bdb1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:45.980618 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b6d505d2-b1b6-4a2a-9312-6e660e11bdb1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:45.989423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b6d505d2-b1b6-4a2a-9312-6e660e11bdb1 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1523 microversion: 2.1 time: 0.154214 Aug 29 19:13:45.990015 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 452/896] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:45 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:46.725432 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b5c2f188-f384-4123-81ad-2c20f2773b9f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:46.726287 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b5c2f188-f384-4123-81ad-2c20f2773b9f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:46.733093 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c2f188-f384-4123-81ad-2c20f2773b9f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:46.733693 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c2f188-f384-4123-81ad-2c20f2773b9f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:46.734230 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c2f188-f384-4123-81ad-2c20f2773b9f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:46.735809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c2f188-f384-4123-81ad-2c20f2773b9f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:46.736475 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c2f188-f384-4123-81ad-2c20f2773b9f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:46.736997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b5c2f188-f384-4123-81ad-2c20f2773b9f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:46.771579 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-80f515c7-2e12-43b8-9c65-ddf744f9d9a5 req-012b7541-ac5a-40d8-a49f-f11725f22daf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b28b5c17-0afa-4fff-a814-653688b1231b", "name": "network-vif-deleted", "tag": "ea5f3186-99cf-44d9-91d3-f823d8b73573"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:46.780945 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-80f515c7-2e12-43b8-9c65-ddf744f9d9a5 req-012b7541-ac5a-40d8-a49f-f11725f22daf service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:46.781419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-80f515c7-2e12-43b8-9c65-ddf744f9d9a5 req-012b7541-ac5a-40d8-a49f-f11725f22daf service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:46.782380 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-80f515c7-2e12-43b8-9c65-ddf744f9d9a5 req-012b7541-ac5a-40d8-a49f-f11725f22daf service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:46.796065 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-80f515c7-2e12-43b8-9c65-ddf744f9d9a5 req-012b7541-ac5a-40d8-a49f-f11725f22daf service nova] Creating event network-vif-deleted:ea5f3186-99cf-44d9-91d3-f823d8b73573 for instance b28b5c17-0afa-4fff-a814-653688b1231b on hv-cinder-73126 Aug 29 19:13:46.801874 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-80f515c7-2e12-43b8-9c65-ddf744f9d9a5 req-012b7541-ac5a-40d8-a49f-f11725f22daf service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033786 Aug 29 19:13:46.802730 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 453/897] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:13:46.873866 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b5c2f188-f384-4123-81ad-2c20f2773b9f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:46.881726 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b5c2f188-f384-4123-81ad-2c20f2773b9f tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1265 microversion: 2.1 time: 0.160647 Aug 29 19:13:46.882302 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 445/898] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:46 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:47.011749 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9d208674-4151-4955-b593-4310742cc10e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:47.012361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9d208674-4151-4955-b593-4310742cc10e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:47.019573 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d208674-4151-4955-b593-4310742cc10e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:47.020060 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d208674-4151-4955-b593-4310742cc10e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:47.020498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d208674-4151-4955-b593-4310742cc10e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:47.021203 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d208674-4151-4955-b593-4310742cc10e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:47.021654 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d208674-4151-4955-b593-4310742cc10e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:47.022078 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9d208674-4151-4955-b593-4310742cc10e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:47.089086 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9d208674-4151-4955-b593-4310742cc10e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:47.099357 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9d208674-4151-4955-b593-4310742cc10e tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1481 microversion: 2.1 time: 0.091847 Aug 29 19:13:47.099950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 454/899] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:47 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1481 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:47.778587 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-611f25f9-22d3-4a59-9201-de289532ea49 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:47.779137 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-611f25f9-22d3-4a59-9201-de289532ea49 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:47.790150 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-611f25f9-22d3-4a59-9201-de289532ea49 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:47.790719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-611f25f9-22d3-4a59-9201-de289532ea49 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:47.791332 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-611f25f9-22d3-4a59-9201-de289532ea49 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:47.792159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-611f25f9-22d3-4a59-9201-de289532ea49 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:47.792712 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-611f25f9-22d3-4a59-9201-de289532ea49 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:47.793232 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-611f25f9-22d3-4a59-9201-de289532ea49 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:47.823509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-611f25f9-22d3-4a59-9201-de289532ea49 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lazy-loading 'flavor' on Instance uuid 337970a7-0d96-4590-bbf0-e7e1b2fae6ac {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:13:47.890792 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d3f9a879-f025-4382-91a9-ca8502b7f3d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:47.891956 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d3f9a879-f025-4382-91a9-ca8502b7f3d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:47.892668 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:47.898469 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3f9a879-f025-4382-91a9-ca8502b7f3d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:47.898929 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3f9a879-f025-4382-91a9-ca8502b7f3d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:47.899405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3f9a879-f025-4382-91a9-ca8502b7f3d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:47.900108 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3f9a879-f025-4382-91a9-ca8502b7f3d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:47.900570 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3f9a879-f025-4382-91a9-ca8502b7f3d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:47.901014 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d3f9a879-f025-4382-91a9-ca8502b7f3d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:47.902832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-611f25f9-22d3-4a59-9201-de289532ea49 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "POST /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac/action" status: 202 len: 0 microversion: 2.1 time: 0.128124 Aug 29 19:13:47.906892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 446/900] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:13:47 2022] POST /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:13:47.909029 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3711d1ba-2a35-4d6d-807e-c2cacab44f31 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:47.909738 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3711d1ba-2a35-4d6d-807e-c2cacab44f31 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:47.917031 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3711d1ba-2a35-4d6d-807e-c2cacab44f31 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:47.917524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3711d1ba-2a35-4d6d-807e-c2cacab44f31 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:47.917964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3711d1ba-2a35-4d6d-807e-c2cacab44f31 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:47.918922 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3711d1ba-2a35-4d6d-807e-c2cacab44f31 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:47.919506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3711d1ba-2a35-4d6d-807e-c2cacab44f31 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:47.919942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3711d1ba-2a35-4d6d-807e-c2cacab44f31 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:47.927295 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d3f9a879-f025-4382-91a9-ca8502b7f3d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/ips" status: 200 len: 152 microversion: 2.20 time: 0.040491 Aug 29 19:13:47.934385 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 455/901] 10.222.0.94 () {60 vars in 1289 bytes} [Mon Aug 29 19:13:47 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 19:13:47.940134 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-dc69d36d-717b-43ab-825e-a3b6e5f50463 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:47.940884 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-dc69d36d-717b-43ab-825e-a3b6e5f50463 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:47.947527 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc69d36d-717b-43ab-825e-a3b6e5f50463 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:47.948129 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc69d36d-717b-43ab-825e-a3b6e5f50463 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:47.948675 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc69d36d-717b-43ab-825e-a3b6e5f50463 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:47.949504 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc69d36d-717b-43ab-825e-a3b6e5f50463 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:47.950430 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc69d36d-717b-43ab-825e-a3b6e5f50463 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:47.950616 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-dc69d36d-717b-43ab-825e-a3b6e5f50463 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:48.224183 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3711d1ba-2a35-4d6d-807e-c2cacab44f31 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:48.233606 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3711d1ba-2a35-4d6d-807e-c2cacab44f31 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1265 microversion: 2.1 time: 0.328895 Aug 29 19:13:48.234991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 447/902] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:47 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1265 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:48.248482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-dc69d36d-717b-43ab-825e-a3b6e5f50463 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:48.254658 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:48.255630 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:48.258982 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-dc69d36d-717b-43ab-825e-a3b6e5f50463 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.323416 Aug 29 19:13:48.262059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:48.262552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:48.262879 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 456/903] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:47 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:48.263016 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:48.263721 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:48.264184 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:48.264614 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:48.305006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:48.305504 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:48.305998 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:48.306450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lazy-loading 'fault' on Instance uuid b28b5c17-0afa-4fff-a814-653688b1231b {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:13:48.372663 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73c4a7ab7fc7425389843798faa25372', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b429eb37f4ed408d830ef2c1034e9bdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:48.383126 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-df018ea5-e9e5-4062-b309-2ee36abb8023 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 200 len: 1312 microversion: 2.1 time: 0.133165 Aug 29 19:13:48.383696 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 448/904] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:48 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 1312 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:49.259222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ab20380f-81d4-473a-9fe9-c97bfeaa2547 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:49.259924 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ab20380f-81d4-473a-9fe9-c97bfeaa2547 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:49.266460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab20380f-81d4-473a-9fe9-c97bfeaa2547 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:49.267019 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab20380f-81d4-473a-9fe9-c97bfeaa2547 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:49.267576 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab20380f-81d4-473a-9fe9-c97bfeaa2547 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:49.268274 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab20380f-81d4-473a-9fe9-c97bfeaa2547 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:49.268718 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab20380f-81d4-473a-9fe9-c97bfeaa2547 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:49.269140 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ab20380f-81d4-473a-9fe9-c97bfeaa2547 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:49.285989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b78aafb2-6927-4606-bcb7-24d40b3258a2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:49.286744 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b78aafb2-6927-4606-bcb7-24d40b3258a2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:49.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b78aafb2-6927-4606-bcb7-24d40b3258a2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:49.294635 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b78aafb2-6927-4606-bcb7-24d40b3258a2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:49.295114 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b78aafb2-6927-4606-bcb7-24d40b3258a2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:49.295830 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b78aafb2-6927-4606-bcb7-24d40b3258a2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:49.296413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b78aafb2-6927-4606-bcb7-24d40b3258a2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:49.296853 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b78aafb2-6927-4606-bcb7-24d40b3258a2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:49.558743 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ab20380f-81d4-473a-9fe9-c97bfeaa2547 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:49.566773 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ab20380f-81d4-473a-9fe9-c97bfeaa2547 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1452 microversion: 2.1 time: 0.311403 Aug 29 19:13:49.567660 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 457/905] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:49 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1452 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:49.568563 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b78aafb2-6927-4606-bcb7-24d40b3258a2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:49.572659 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:49.573269 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] [instance: b28b5c17-0afa-4fff-a814-653688b1231b] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:49.577499 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b78aafb2-6927-4606-bcb7-24d40b3258a2 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.296459 Aug 29 19:13:49.581185 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:49.581893 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:49.582501 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:49.583395 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:49.584087 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:49.584572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 449/906] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:49 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:49.584921 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:49.590634 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c3a56896-0493-4b2b-afa3-d2cfda4cee7c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:49.592409 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c3a56896-0493-4b2b-afa3-d2cfda4cee7c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:49.599266 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3a56896-0493-4b2b-afa3-d2cfda4cee7c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:49.599839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3a56896-0493-4b2b-afa3-d2cfda4cee7c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:49.600350 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3a56896-0493-4b2b-afa3-d2cfda4cee7c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:49.600647 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] HTTP exception thrown: Instance b28b5c17-0afa-4fff-a814-653688b1231b could not be found. Aug 29 19:13:49.601189 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3a56896-0493-4b2b-afa3-d2cfda4cee7c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Request method failure captured: Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b HTTP/1.1 Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6E5qq19XpHwlOHkTbjyma9QlFTrqFt7b9-twpMAOXdQdC0jV3pWUGE_MXRfTm_NQ3UnXuJjxiqQl_lHPtfUSarmRjbywIggIk9H_6vW-4_SeCMX7AMBMSIiCdM2J_TOMs4lmb3ACxn7AXkq0BEDSHTDmoEaY1zLgOYRdtjW6wZifc Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: b429eb37f4ed408d830ef2c1034e9bdc Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:13:49.602302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b429eb37f4ed408d830ef2c1034e9bdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b429eb37f4ed408d830ef2c1034e9bdc"}]}] Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: b429eb37f4ed408d830ef2c1034e9bdc Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1171381257 Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-ServerRescueNegativeTestJSON-1171381257-project Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 73c4a7ab7fc7425389843798faa25372 Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1171381257-project Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance b28b5c17-0afa-4fff-a814-653688b1231b could not be found. Aug 29 19:13:49.603847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': 'b28b5c17-0afa-4fff-a814-653688b1231b'} Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b28b5c17-0afa-4fff-a814-653688b1231b could not be found. Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:13:49.604843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b28b5c17-0afa-4fff-a814-653688b1231b could not be found. Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b28b5c17-0afa-4fff-a814-653688b1231b could not be found. Aug 29 19:13:49.608049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:13:49.609940 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] Returning 404 to user: Instance b28b5c17-0afa-4fff-a814-653688b1231b could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:13:49.610049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3a56896-0493-4b2b-afa3-d2cfda4cee7c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:49.610164 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-24cffee2-fadb-403d-8be7-9201a947e936 tempest-ServerRescueNegativeTestJSON-1171381257 tempest-ServerRescueNegativeTestJSON-1171381257-project] 10.222.0.94 "GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b" status: 404 len: 111 microversion: 2.1 time: 0.034824 Aug 29 19:13:49.610369 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c3a56896-0493-4b2b-afa3-d2cfda4cee7c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:49.610461 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 458/907] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:49 2022] GET /compute/v2.1/servers/b28b5c17-0afa-4fff-a814-653688b1231b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:13:49.794750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c3a56896-0493-4b2b-afa3-d2cfda4cee7c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:49.803384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c3a56896-0493-4b2b-afa3-d2cfda4cee7c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1452 microversion: 2.1 time: 0.217557 Aug 29 19:13:49.803962 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 450/908] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:49 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1452 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:50.386052 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-69b8655e-bc41-4636-bd81-19e0430f4358 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:50.387789 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-69b8655e-bc41-4636-bd81-19e0430f4358 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:50.397659 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69b8655e-bc41-4636-bd81-19e0430f4358 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:50.398570 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69b8655e-bc41-4636-bd81-19e0430f4358 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:50.399491 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69b8655e-bc41-4636-bd81-19e0430f4358 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:50.400301 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69b8655e-bc41-4636-bd81-19e0430f4358 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:50.401246 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69b8655e-bc41-4636-bd81-19e0430f4358 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:50.401740 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-69b8655e-bc41-4636-bd81-19e0430f4358 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:50.435403 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-69b8655e-bc41-4636-bd81-19e0430f4358 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lazy-loading 'flavor' on Instance uuid 9713d174-1918-4168-b6e7-bf1359b50155 {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:13:50.598986 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-185c0eee-d4e0-4ccd-8519-db7761e63962 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:50.600165 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-185c0eee-d4e0-4ccd-8519-db7761e63962 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:50.609891 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-185c0eee-d4e0-4ccd-8519-db7761e63962 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:50.610828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-185c0eee-d4e0-4ccd-8519-db7761e63962 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:50.611517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-185c0eee-d4e0-4ccd-8519-db7761e63962 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:50.612510 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-185c0eee-d4e0-4ccd-8519-db7761e63962 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:50.613134 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-185c0eee-d4e0-4ccd-8519-db7761e63962 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:50.613806 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-185c0eee-d4e0-4ccd-8519-db7761e63962 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:50.653975 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-69b8655e-bc41-4636-bd81-19e0430f4358 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "POST /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/action" status: 202 len: 0 microversion: 2.20 time: 0.276798 Aug 29 19:13:50.654681 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 459/909] 10.222.0.94 () {62 vars in 1319 bytes} [Mon Aug 29 19:13:50 2022] POST /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:13:50.664745 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:50.665618 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:50.672823 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:50.673697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:50.674232 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:50.675045 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:50.675634 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:50.676163 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:50.909233 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-185c0eee-d4e0-4ccd-8519-db7761e63962 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:50.919850 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-185c0eee-d4e0-4ccd-8519-db7761e63962 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.324648 Aug 29 19:13:50.920440 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 451/910] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:50 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:50.961262 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:50.971514 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:50.972971 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:50.974384 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e9747969-a5a8-4218-8559-5ce744610bca tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.314887 Aug 29 19:13:50.975135 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 460/911] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:13:50 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:13:51.493766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-d1d012e2-3a1a-41e7-8827-4291b3cac88c req-c06c2b13-b2d9-4a5e-8d66-f52b52b1223d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b9dcd0-904c-434b-880c-a80e86c01055", "tag": "adcd197a-d293-4fcc-aa1a-bea1781ba4dc"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:13:51.505637 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-d1d012e2-3a1a-41e7-8827-4291b3cac88c req-c06c2b13-b2d9-4a5e-8d66-f52b52b1223d service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:51.506121 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-d1d012e2-3a1a-41e7-8827-4291b3cac88c req-c06c2b13-b2d9-4a5e-8d66-f52b52b1223d service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:51.506783 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-d1d012e2-3a1a-41e7-8827-4291b3cac88c req-c06c2b13-b2d9-4a5e-8d66-f52b52b1223d service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:51.519107 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-d1d012e2-3a1a-41e7-8827-4291b3cac88c req-c06c2b13-b2d9-4a5e-8d66-f52b52b1223d service nova] Creating event network-changed:adcd197a-d293-4fcc-aa1a-bea1781ba4dc for instance 79b9dcd0-904c-434b-880c-a80e86c01055 on hv-cinder-73126 Aug 29 19:13:51.524237 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-d1d012e2-3a1a-41e7-8827-4291b3cac88c req-c06c2b13-b2d9-4a5e-8d66-f52b52b1223d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034201 Aug 29 19:13:51.525348 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 452/912] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:13:51.946096 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9337c2eb-23a1-436b-b67d-81a532e5f260 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:51.946773 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9337c2eb-23a1-436b-b67d-81a532e5f260 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:51.953871 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9337c2eb-23a1-436b-b67d-81a532e5f260 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:51.954845 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9337c2eb-23a1-436b-b67d-81a532e5f260 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:51.955572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9337c2eb-23a1-436b-b67d-81a532e5f260 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:51.956644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9337c2eb-23a1-436b-b67d-81a532e5f260 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:51.957874 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9337c2eb-23a1-436b-b67d-81a532e5f260 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:51.958756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9337c2eb-23a1-436b-b67d-81a532e5f260 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:51.999862 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:52.001887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:52.010353 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:52.011283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:52.011942 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:52.012924 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:52.013602 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:52.014311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:52.365260 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-9337c2eb-23a1-436b-b67d-81a532e5f260 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:52.385690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9337c2eb-23a1-436b-b67d-81a532e5f260 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.443598 Aug 29 19:13:52.400811 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 461/913] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:51 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:52.405997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:52.418368 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:52.421049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:52.428205 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5fd1f827-dde4-4e96-a238-d000f90c6ce5 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.434124 Aug 29 19:13:52.439268 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 453/914] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:13:51 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:13:53.409776 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d4043d5c-d3a0-41fb-a928-cfd9d4e0116f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:53.411283 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d4043d5c-d3a0-41fb-a928-cfd9d4e0116f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:53.421504 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4043d5c-d3a0-41fb-a928-cfd9d4e0116f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:53.422002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4043d5c-d3a0-41fb-a928-cfd9d4e0116f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:53.423205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4043d5c-d3a0-41fb-a928-cfd9d4e0116f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:53.423859 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4043d5c-d3a0-41fb-a928-cfd9d4e0116f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:53.424624 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4043d5c-d3a0-41fb-a928-cfd9d4e0116f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:53.424754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d4043d5c-d3a0-41fb-a928-cfd9d4e0116f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:53.453335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:53.454113 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:53.464367 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:53.464890 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:53.465521 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:53.466299 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:53.466879 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:53.467739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:53.701694 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d4043d5c-d3a0-41fb-a928-cfd9d4e0116f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:53.710825 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d4043d5c-d3a0-41fb-a928-cfd9d4e0116f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.304893 Aug 29 19:13:53.712122 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 462/915] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:53 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:53.728773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:53.738754 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:53.740352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:53.742210 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b33798ae-cb1f-47bf-96bd-49b426691556 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.294250 Aug 29 19:13:53.742866 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 454/916] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:13:53 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:13:54.733678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1c688196-bc59-4d1a-8062-11d6062d3ed5 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:54.734544 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1c688196-bc59-4d1a-8062-11d6062d3ed5 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:54.741176 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1c688196-bc59-4d1a-8062-11d6062d3ed5 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:54.741745 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1c688196-bc59-4d1a-8062-11d6062d3ed5 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:54.742456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1c688196-bc59-4d1a-8062-11d6062d3ed5 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:54.743281 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1c688196-bc59-4d1a-8062-11d6062d3ed5 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:54.743798 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1c688196-bc59-4d1a-8062-11d6062d3ed5 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:54.744307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1c688196-bc59-4d1a-8062-11d6062d3ed5 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:54.765857 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:54.767699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:54.773866 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:54.774366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:54.774996 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:54.775733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:54.776185 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:54.776838 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:54.966282 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1c688196-bc59-4d1a-8062-11d6062d3ed5 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:54.972241 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:54.975533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1c688196-bc59-4d1a-8062-11d6062d3ed5 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.245956 Aug 29 19:13:54.976850 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 463/917] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:54 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:54.981090 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:54.982527 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:54.983719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a520909c-d99e-4da8-84e7-0ebab42047cb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.221708 Aug 29 19:13:54.984546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 455/918] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:13:54 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:13:55.999385 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e4302a77-801b-495e-b6f8-d29209db8004 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:56.000003 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e4302a77-801b-495e-b6f8-d29209db8004 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:56.006929 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4302a77-801b-495e-b6f8-d29209db8004 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:56.007146 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:56.007567 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4302a77-801b-495e-b6f8-d29209db8004 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:56.007662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:56.007968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4302a77-801b-495e-b6f8-d29209db8004 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:56.008673 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4302a77-801b-495e-b6f8-d29209db8004 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:56.009136 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4302a77-801b-495e-b6f8-d29209db8004 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:56.009564 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e4302a77-801b-495e-b6f8-d29209db8004 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:56.014232 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:56.014716 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:56.015183 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:56.015878 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:56.016385 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:56.016899 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:56.215712 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:56.219696 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e4302a77-801b-495e-b6f8-d29209db8004 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:56.224148 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:13:56.224917 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:56.226640 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:56.228043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ecfddcf6-62a2-4f25-ac2d-a611eee1f073 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.224709 Aug 29 19:13:56.228600 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 456/919] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:13:56 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:13:56.229806 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e4302a77-801b-495e-b6f8-d29209db8004 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.234304 Aug 29 19:13:56.230629 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 464/920] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:55 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:57.253222 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:57.253769 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5011e2e6-71d9-41a5-b9a3-cbec349542da tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:57.254141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:57.254242 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5011e2e6-71d9-41a5-b9a3-cbec349542da tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:57.260459 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:57.260951 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:57.261433 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:57.262073 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5011e2e6-71d9-41a5-b9a3-cbec349542da tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:57.262218 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:57.262528 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5011e2e6-71d9-41a5-b9a3-cbec349542da tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:57.262669 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:57.262960 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5011e2e6-71d9-41a5-b9a3-cbec349542da tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:57.263084 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:57.263682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5011e2e6-71d9-41a5-b9a3-cbec349542da tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:57.264140 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5011e2e6-71d9-41a5-b9a3-cbec349542da tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:57.264561 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5011e2e6-71d9-41a5-b9a3-cbec349542da tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:57.468240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:57.471760 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5011e2e6-71d9-41a5-b9a3-cbec349542da tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:57.478407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:57.479532 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5011e2e6-71d9-41a5-b9a3-cbec349542da tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.230225 Aug 29 19:13:57.480270 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 465/921] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:57 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:13:57.481252 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:57.482424 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f267abb3-0caf-4148-a61f-86990efcf9dd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.233658 Aug 29 19:13:57.482967 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 457/922] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:13:57 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:13:58.501784 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6cbb4904-3b87-469a-a514-eca83ad84322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:58.502746 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6cbb4904-3b87-469a-a514-eca83ad84322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:58.508359 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:58.508991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:58.510338 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6cbb4904-3b87-469a-a514-eca83ad84322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:58.510826 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6cbb4904-3b87-469a-a514-eca83ad84322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:58.511288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6cbb4904-3b87-469a-a514-eca83ad84322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:58.511985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6cbb4904-3b87-469a-a514-eca83ad84322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:58.512436 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6cbb4904-3b87-469a-a514-eca83ad84322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:58.512854 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6cbb4904-3b87-469a-a514-eca83ad84322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:58.515423 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:58.515930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:58.516519 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:58.517221 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:58.517678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:58.518103 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:58.797381 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:58.806307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:58.807822 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:58.809001 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-01ee75b2-e458-48c8-a3a9-dae380af0b35 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.305767 Aug 29 19:13:58.809563 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 458/923] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:13:58 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:13:58.819265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6cbb4904-3b87-469a-a514-eca83ad84322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:13:58.827791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6cbb4904-3b87-469a-a514-eca83ad84322 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.330786 Aug 29 19:13:58.828370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 466/924] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:58 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:13:59.834845 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:59.836342 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:59.845049 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:59.846127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:59.846732 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:59.847810 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:59.848487 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:59.849113 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:59.851401 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-89b4bd72-b5c4-4ac9-9422-9b396fc0f215 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:13:59.852160 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-89b4bd72-b5c4-4ac9-9422-9b396fc0f215 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:13:59.861789 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89b4bd72-b5c4-4ac9-9422-9b396fc0f215 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:59.862762 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89b4bd72-b5c4-4ac9-9422-9b396fc0f215 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:59.863456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89b4bd72-b5c4-4ac9-9422-9b396fc0f215 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:13:59.864836 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89b4bd72-b5c4-4ac9-9422-9b396fc0f215 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:13:59.865500 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89b4bd72-b5c4-4ac9-9422-9b396fc0f215 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:13:59.866120 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89b4bd72-b5c4-4ac9-9422-9b396fc0f215 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:00.118493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:00.128661 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:00.130379 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:00.131626 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9d7be5bb-fccf-475a-8590-8ee65f4e5e45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.302283 Aug 29 19:14:00.141466 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-89b4bd72-b5c4-4ac9-9422-9b396fc0f215 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:00.143616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 459/925] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:13:59 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:00.151400 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-89b4bd72-b5c4-4ac9-9422-9b396fc0f215 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.306246 Aug 29 19:14:00.152073 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 467/926] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:13:59 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:01.156400 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:01.157048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:01.163524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:01.164015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:01.164455 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:01.165161 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:01.165622 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:01.166061 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:01.178146 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-fa89b7f1-a6d5-468f-ac76-8162661316dd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:01.179380 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-fa89b7f1-a6d5-468f-ac76-8162661316dd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:01.187487 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:01.187708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa89b7f1-a6d5-468f-ac76-8162661316dd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:01.190593 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa89b7f1-a6d5-468f-ac76-8162661316dd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:01.191153 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa89b7f1-a6d5-468f-ac76-8162661316dd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:01.191991 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa89b7f1-a6d5-468f-ac76-8162661316dd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:01.192518 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa89b7f1-a6d5-468f-ac76-8162661316dd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:01.193039 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-fa89b7f1-a6d5-468f-ac76-8162661316dd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:01.386724 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:01.397024 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:01.397223 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-fa89b7f1-a6d5-468f-ac76-8162661316dd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:01.398963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:01.400363 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6aef4a16-4515-4ddd-99a6-c67ade997f78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.248079 Aug 29 19:14:01.401084 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 460/927] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:01 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:01.406754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-fa89b7f1-a6d5-468f-ac76-8162661316dd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.234254 Aug 29 19:14:01.408100 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 468/928] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:01 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:02.434766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:02.436138 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:02.438002 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c03b90f9-4015-4768-822f-13ef5cde9a88 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:02.439505 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c03b90f9-4015-4768-822f-13ef5cde9a88 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:02.444060 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:02.445548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:02.446151 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:02.446394 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c03b90f9-4015-4768-822f-13ef5cde9a88 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:02.446716 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:02.447155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c03b90f9-4015-4768-822f-13ef5cde9a88 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:02.447465 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:02.447614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c03b90f9-4015-4768-822f-13ef5cde9a88 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:02.448261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:02.448384 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c03b90f9-4015-4768-822f-13ef5cde9a88 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:02.448891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c03b90f9-4015-4768-822f-13ef5cde9a88 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:02.449591 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c03b90f9-4015-4768-822f-13ef5cde9a88 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:02.449967 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:02.658812 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:02.667203 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:02.668981 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:02.670650 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-03ac5f4d-db71-4110-b0ed-ad3106b2c7bb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.241520 Aug 29 19:14:02.671325 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 461/929] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:02 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:02.678538 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c03b90f9-4015-4768-822f-13ef5cde9a88 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:02.686342 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c03b90f9-4015-4768-822f-13ef5cde9a88 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1510 microversion: 2.1 time: 0.252182 Aug 29 19:14:02.686842 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 469/930] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:02 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:02.707295 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-18a818bb-bae4-4924-ab80-d055a5018c89 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:02.708559 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-18a818bb-bae4-4924-ab80-d055a5018c89 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:02.714445 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18a818bb-bae4-4924-ab80-d055a5018c89 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:02.714943 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18a818bb-bae4-4924-ab80-d055a5018c89 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:02.715420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18a818bb-bae4-4924-ab80-d055a5018c89 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:02.716119 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18a818bb-bae4-4924-ab80-d055a5018c89 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:02.716586 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18a818bb-bae4-4924-ab80-d055a5018c89 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:02.717018 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-18a818bb-bae4-4924-ab80-d055a5018c89 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:02.747474 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-18a818bb-bae4-4924-ab80-d055a5018c89 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=115968) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 19:14:02.806250 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:02.821844 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-18a818bb-bae4-4924-ab80-d055a5018c89 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "POST /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac/action" status: 202 len: 0 microversion: 2.1 time: 0.118940 Aug 29 19:14:02.822531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 462/931] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:14:02 2022] POST /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:14:02.834273 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2f9b65b8-7e9c-4e71-8bcc-0db538e42cfd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:02.835685 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2f9b65b8-7e9c-4e71-8bcc-0db538e42cfd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:02.844621 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f9b65b8-7e9c-4e71-8bcc-0db538e42cfd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:02.846264 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f9b65b8-7e9c-4e71-8bcc-0db538e42cfd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:02.846704 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f9b65b8-7e9c-4e71-8bcc-0db538e42cfd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:02.847614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f9b65b8-7e9c-4e71-8bcc-0db538e42cfd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:02.847916 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f9b65b8-7e9c-4e71-8bcc-0db538e42cfd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:02.848538 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f9b65b8-7e9c-4e71-8bcc-0db538e42cfd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:03.007571 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2f9b65b8-7e9c-4e71-8bcc-0db538e42cfd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:03.018179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2f9b65b8-7e9c-4e71-8bcc-0db538e42cfd tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1518 microversion: 2.1 time: 0.190577 Aug 29 19:14:03.018811 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 470/932] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:02 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1518 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:03.207264 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2f1f2d84-2e18-4288-9eaf-0639c1c7b589 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:03.208108 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2f1f2d84-2e18-4288-9eaf-0639c1c7b589 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:03.214271 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2f1f2d84-2e18-4288-9eaf-0639c1c7b589 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:03.214771 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2f1f2d84-2e18-4288-9eaf-0639c1c7b589 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:03.215262 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2f1f2d84-2e18-4288-9eaf-0639c1c7b589 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:03.215959 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2f1f2d84-2e18-4288-9eaf-0639c1c7b589 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:03.216420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2f1f2d84-2e18-4288-9eaf-0639c1c7b589 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:03.216854 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2f1f2d84-2e18-4288-9eaf-0639c1c7b589 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:03.240576 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2f1f2d84-2e18-4288-9eaf-0639c1c7b589 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/ips" status: 200 len: 145 microversion: 2.1 time: 0.039643 Aug 29 19:14:03.241328 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 463/933] 10.222.0.94 () {58 vars in 1248 bytes} [Mon Aug 29 19:14:03 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:03.706375 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:03.707103 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:03.714016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:03.714437 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:03.714871 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:03.716524 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:03.716991 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:03.717416 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:03.889489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:03.898843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:03.900340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:03.901526 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-aebc7b67-7d9b-4d56-9884-e1af12e9a0e7 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.200035 Aug 29 19:14:03.902181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 471/934] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:03 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:04.041182 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-805e2f22-2507-4568-bbce-77aafcad0d98 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:04.042207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-805e2f22-2507-4568-bbce-77aafcad0d98 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:04.051445 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-805e2f22-2507-4568-bbce-77aafcad0d98 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:04.052081 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-805e2f22-2507-4568-bbce-77aafcad0d98 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:04.052515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-805e2f22-2507-4568-bbce-77aafcad0d98 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:04.053994 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-805e2f22-2507-4568-bbce-77aafcad0d98 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:04.054618 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-805e2f22-2507-4568-bbce-77aafcad0d98 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:04.055202 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-805e2f22-2507-4568-bbce-77aafcad0d98 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:04.195315 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-805e2f22-2507-4568-bbce-77aafcad0d98 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:04.203315 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-805e2f22-2507-4568-bbce-77aafcad0d98 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1520 microversion: 2.1 time: 0.168095 Aug 29 19:14:04.204851 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 464/935] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:04 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:04.644882 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7fb11ac9-a5d4-4fa2-acd4-d6956e86465c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd58edc4-a9c5-4a59-a141-0aca4835532e"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:04.647346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7fb11ac9-a5d4-4fa2-acd4-d6956e86465c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:04.654862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7fb11ac9-a5d4-4fa2-acd4-d6956e86465c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:04.655624 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7fb11ac9-a5d4-4fa2-acd4-d6956e86465c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:04.656339 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7fb11ac9-a5d4-4fa2-acd4-d6956e86465c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:04.657190 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7fb11ac9-a5d4-4fa2-acd4-d6956e86465c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:04.657895 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7fb11ac9-a5d4-4fa2-acd4-d6956e86465c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:04.658250 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7fb11ac9-a5d4-4fa2-acd4-d6956e86465c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:04.927536 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:04.928448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:04.937056 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:04.937551 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:04.937989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:04.939603 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:04.940211 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:04.940818 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:05.056712 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7fb11ac9-a5d4-4fa2-acd4-d6956e86465c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "POST /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414738 Aug 29 19:14:05.057682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 472/936] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:14:04 2022] POST /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments => generated 194 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:05.116495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:05.125584 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:05.127263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:05.129091 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-74f12d93-c20f-4f8d-93f8-152ddb0e5809 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.206754 Aug 29 19:14:05.129718 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 465/937] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:04 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:14:05.226633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b19f88c3-5ab2-4fc9-9ae7-9a9bb1ba5c46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:05.227364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b19f88c3-5ab2-4fc9-9ae7-9a9bb1ba5c46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:05.234523 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19f88c3-5ab2-4fc9-9ae7-9a9bb1ba5c46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:05.235138 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19f88c3-5ab2-4fc9-9ae7-9a9bb1ba5c46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:05.235538 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19f88c3-5ab2-4fc9-9ae7-9a9bb1ba5c46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:05.236355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19f88c3-5ab2-4fc9-9ae7-9a9bb1ba5c46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:05.236816 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19f88c3-5ab2-4fc9-9ae7-9a9bb1ba5c46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:05.237240 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b19f88c3-5ab2-4fc9-9ae7-9a9bb1ba5c46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:05.374508 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b19f88c3-5ab2-4fc9-9ae7-9a9bb1ba5c46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:05.382632 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b19f88c3-5ab2-4fc9-9ae7-9a9bb1ba5c46 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1576 microversion: 2.1 time: 0.160392 Aug 29 19:14:05.383336 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 473/938] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:05 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:06.073839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-09463f36-4b89-4a2d-9c5f-d854dd1bbdda req-30b84ddf-1f1d-4d06-9bc2-9acd67200024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337970a7-0d96-4590-bbf0-e7e1b2fae6ac", "name": "network-vif-unplugged", "status": "completed", "tag": "bc2fe8d5-1c6f-407b-8613-774dc48866ca"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:06.087285 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-09463f36-4b89-4a2d-9c5f-d854dd1bbdda req-30b84ddf-1f1d-4d06-9bc2-9acd67200024 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:06.088094 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-09463f36-4b89-4a2d-9c5f-d854dd1bbdda req-30b84ddf-1f1d-4d06-9bc2-9acd67200024 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:06.088988 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-09463f36-4b89-4a2d-9c5f-d854dd1bbdda req-30b84ddf-1f1d-4d06-9bc2-9acd67200024 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:06.104611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-09463f36-4b89-4a2d-9c5f-d854dd1bbdda req-30b84ddf-1f1d-4d06-9bc2-9acd67200024 service nova] Creating event network-vif-unplugged:bc2fe8d5-1c6f-407b-8613-774dc48866ca for instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac on hv-cinder-73126 Aug 29 19:14:06.111004 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-09463f36-4b89-4a2d-9c5f-d854dd1bbdda req-30b84ddf-1f1d-4d06-9bc2-9acd67200024 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041137 Aug 29 19:14:06.112283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 466/939] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:14:06.154305 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:06.155084 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:06.162733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:06.163650 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:06.164160 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:06.164938 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:06.165404 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:06.165835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:06.381989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:06.392910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:06.394345 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:06.395533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b04e77b8-978a-4fef-a39b-af7060e55993 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.245028 Aug 29 19:14:06.404608 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-14a4bf67-fde4-48b2-8eb3-d7873df8b775 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:06.405303 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-14a4bf67-fde4-48b2-8eb3-d7873df8b775 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:06.412127 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 474/940] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:06 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:06.414503 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-14a4bf67-fde4-48b2-8eb3-d7873df8b775 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:06.414996 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-14a4bf67-fde4-48b2-8eb3-d7873df8b775 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:06.415462 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-14a4bf67-fde4-48b2-8eb3-d7873df8b775 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:06.416161 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-14a4bf67-fde4-48b2-8eb3-d7873df8b775 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:06.416617 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-14a4bf67-fde4-48b2-8eb3-d7873df8b775 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:06.417041 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-14a4bf67-fde4-48b2-8eb3-d7873df8b775 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:06.556721 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-14a4bf67-fde4-48b2-8eb3-d7873df8b775 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:06.565615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-14a4bf67-fde4-48b2-8eb3-d7873df8b775 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1576 microversion: 2.1 time: 0.165084 Aug 29 19:14:06.566179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 467/941] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:06 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:07.418003 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:07.418612 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:07.425813 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:07.426293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:07.426726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:07.427453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:07.427905 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:07.428322 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:07.559004 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:07.570513 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:07.572011 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:07.573235 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e1d33197-a3b6-4914-ac41-9a89672f1a0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.159316 Aug 29 19:14:07.573801 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 475/942] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:07 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:07.588007 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-224c4e2d-3d36-49be-b031-49fe79739d60 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:07.588846 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-224c4e2d-3d36-49be-b031-49fe79739d60 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:07.595398 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-224c4e2d-3d36-49be-b031-49fe79739d60 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:07.595887 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-224c4e2d-3d36-49be-b031-49fe79739d60 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:07.596331 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-224c4e2d-3d36-49be-b031-49fe79739d60 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:07.597035 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-224c4e2d-3d36-49be-b031-49fe79739d60 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:07.597492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-224c4e2d-3d36-49be-b031-49fe79739d60 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:07.597915 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-224c4e2d-3d36-49be-b031-49fe79739d60 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:07.734402 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-224c4e2d-3d36-49be-b031-49fe79739d60 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:07.743734 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-224c4e2d-3d36-49be-b031-49fe79739d60 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1576 microversion: 2.1 time: 0.160554 Aug 29 19:14:07.756699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 468/943] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:07 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:08.596609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:08.597221 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:08.603829 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:08.604261 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:08.604797 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:08.605396 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:08.605858 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:08.606286 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:08.739812 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:08.748872 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:08.750303 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:08.751666 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e86650f2-892e-4b17-8986-0ff060d98723 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.158940 Aug 29 19:14:08.752254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 476/944] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:08 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:08.764980 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5bc119f6-fd6c-4077-929a-ac683455bfa6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:08.765715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5bc119f6-fd6c-4077-929a-ac683455bfa6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:08.772491 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bc119f6-fd6c-4077-929a-ac683455bfa6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:08.772974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bc119f6-fd6c-4077-929a-ac683455bfa6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:08.773411 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bc119f6-fd6c-4077-929a-ac683455bfa6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:08.774113 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bc119f6-fd6c-4077-929a-ac683455bfa6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:08.774573 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bc119f6-fd6c-4077-929a-ac683455bfa6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:08.775003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5bc119f6-fd6c-4077-929a-ac683455bfa6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:08.910209 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5bc119f6-fd6c-4077-929a-ac683455bfa6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:08.918237 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5bc119f6-fd6c-4077-929a-ac683455bfa6 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1576 microversion: 2.1 time: 0.157156 Aug 29 19:14:08.918922 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 469/945] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:08 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:09.774835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:09.775400 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:09.782050 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:09.782533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:09.782998 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:09.783718 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:09.784176 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:09.784603 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:09.923801 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:09.931969 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:09.933458 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:09.934649 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1f872b15-9326-49d5-b331-505584195e5c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.163782 Aug 29 19:14:09.935228 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 477/946] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:09 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:09.940457 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a8eded62-90b6-4d57-919f-6cd28c963997 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:09.941071 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a8eded62-90b6-4d57-919f-6cd28c963997 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:09.947498 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a8eded62-90b6-4d57-919f-6cd28c963997 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:09.947996 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a8eded62-90b6-4d57-919f-6cd28c963997 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:09.948434 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a8eded62-90b6-4d57-919f-6cd28c963997 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:09.949127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a8eded62-90b6-4d57-919f-6cd28c963997 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:09.949585 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a8eded62-90b6-4d57-919f-6cd28c963997 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:09.950012 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a8eded62-90b6-4d57-919f-6cd28c963997 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:10.078771 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a8eded62-90b6-4d57-919f-6cd28c963997 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:10.086993 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a8eded62-90b6-4d57-919f-6cd28c963997 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1576 microversion: 2.1 time: 0.151023 Aug 29 19:14:10.087605 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 470/947] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:09 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:10.959225 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:10.960169 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:10.966968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:10.967637 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:10.968077 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:10.968781 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:10.969343 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:10.969864 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:11.109702 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d3088d32-4a1b-4834-99eb-2f03696de50a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:11.110959 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d3088d32-4a1b-4834-99eb-2f03696de50a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:11.118131 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:11.130221 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:11.131735 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:11.132917 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cbf79970-eda6-4363-a26c-56ef87c8e772 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.178647 Aug 29 19:14:11.133471 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 478/948] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:10 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:11.133949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d3088d32-4a1b-4834-99eb-2f03696de50a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:11.134466 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d3088d32-4a1b-4834-99eb-2f03696de50a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:11.134899 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d3088d32-4a1b-4834-99eb-2f03696de50a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:11.135709 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d3088d32-4a1b-4834-99eb-2f03696de50a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:11.136468 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d3088d32-4a1b-4834-99eb-2f03696de50a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:11.136886 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d3088d32-4a1b-4834-99eb-2f03696de50a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:11.271821 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d3088d32-4a1b-4834-99eb-2f03696de50a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:11.281146 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d3088d32-4a1b-4834-99eb-2f03696de50a tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1576 microversion: 2.1 time: 0.175723 Aug 29 19:14:11.282593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 471/949] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:11 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:12.155441 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:12.156839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:12.163441 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:12.163925 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:12.164356 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:12.165047 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:12.165502 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:12.165932 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:12.299814 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:12.304739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-47db78d2-414e-43bf-9d95-64e5005d2c09 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:12.305987 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-47db78d2-414e-43bf-9d95-64e5005d2c09 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:12.308233 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:12.309797 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:12.311107 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-831723cb-681d-4bfe-90ac-66f3c4229f55 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1746 microversion: 2.20 time: 0.159542 Aug 29 19:14:12.311672 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 479/950] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:12 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:12.323249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-47db78d2-414e-43bf-9d95-64e5005d2c09 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:12.323249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-47db78d2-414e-43bf-9d95-64e5005d2c09 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:12.323249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-47db78d2-414e-43bf-9d95-64e5005d2c09 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:12.323249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-47db78d2-414e-43bf-9d95-64e5005d2c09 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:12.323758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-47db78d2-414e-43bf-9d95-64e5005d2c09 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:12.323758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-47db78d2-414e-43bf-9d95-64e5005d2c09 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:12.463128 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-47db78d2-414e-43bf-9d95-64e5005d2c09 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:12.471395 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-47db78d2-414e-43bf-9d95-64e5005d2c09 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1576 microversion: 2.1 time: 0.170704 Aug 29 19:14:12.471973 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 472/951] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:12 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:13.339233 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:13.340735 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:13.349582 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:13.350330 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:13.351138 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:13.352439 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:13.353240 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:13.354493 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:13.361623 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:13.493688 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ed1d4cd1-8820-4518-9889-40f3760a4e7b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:13.494819 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ed1d4cd1-8820-4518-9889-40f3760a4e7b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:13.501034 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ed1d4cd1-8820-4518-9889-40f3760a4e7b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:13.501817 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ed1d4cd1-8820-4518-9889-40f3760a4e7b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:13.502262 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ed1d4cd1-8820-4518-9889-40f3760a4e7b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:13.502959 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ed1d4cd1-8820-4518-9889-40f3760a4e7b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:13.503744 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ed1d4cd1-8820-4518-9889-40f3760a4e7b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:13.504332 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ed1d4cd1-8820-4518-9889-40f3760a4e7b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:13.614360 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:13.623270 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:13.624896 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:13.627513 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-05c65310-e5c6-4d23-ba22-e89af0813c70 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1746 microversion: 2.20 time: 0.294126 Aug 29 19:14:13.628708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 480/952] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:13 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1746 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:13.685369 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ed1d4cd1-8820-4518-9889-40f3760a4e7b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:13.693234 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ed1d4cd1-8820-4518-9889-40f3760a4e7b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1576 microversion: 2.1 time: 0.203902 Aug 29 19:14:13.693819 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 473/953] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:13 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:13.788160 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6e353842-7b64-4d74-83f2-de74e31ad6e8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:13.790376 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6e353842-7b64-4d74-83f2-de74e31ad6e8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:13.797728 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e353842-7b64-4d74-83f2-de74e31ad6e8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:13.799205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e353842-7b64-4d74-83f2-de74e31ad6e8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:13.799651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e353842-7b64-4d74-83f2-de74e31ad6e8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:13.800360 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e353842-7b64-4d74-83f2-de74e31ad6e8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:13.800817 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e353842-7b64-4d74-83f2-de74e31ad6e8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:13.801242 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e353842-7b64-4d74-83f2-de74e31ad6e8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:13.832013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6e353842-7b64-4d74-83f2-de74e31ad6e8 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048842 Aug 29 19:14:13.832783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 481/954] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:14:13 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:14:13.843656 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6536e1ea-5cde-4eb3-bfff-45412de13d17 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:13.844461 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6536e1ea-5cde-4eb3-bfff-45412de13d17 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:13.850974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6536e1ea-5cde-4eb3-bfff-45412de13d17 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:13.854368 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6536e1ea-5cde-4eb3-bfff-45412de13d17 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:13.854368 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6536e1ea-5cde-4eb3-bfff-45412de13d17 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:13.854368 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6536e1ea-5cde-4eb3-bfff-45412de13d17 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:13.854368 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6536e1ea-5cde-4eb3-bfff-45412de13d17 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:13.854652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6536e1ea-5cde-4eb3-bfff-45412de13d17 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:13.886195 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6536e1ea-5cde-4eb3-bfff-45412de13d17 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments/cd58edc4-a9c5-4a59-a141-0aca4835532e" status: 200 len: 194 microversion: 2.1 time: 0.046936 Aug 29 19:14:13.891920 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 474/955] 10.222.0.94 () {58 vars in 1413 bytes} [Mon Aug 29 19:14:13 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments/cd58edc4-a9c5-4a59-a141-0aca4835532e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:14.662298 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:14.662897 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:14.672314 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:14.672844 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:14.674286 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:14.675278 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:14.675752 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:14.676189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:14.726815 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-06438bf2-0ee3-410c-ac5e-3cb4eaf6ae1b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:14.727931 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-06438bf2-0ee3-410c-ac5e-3cb4eaf6ae1b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:14.734168 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-06438bf2-0ee3-410c-ac5e-3cb4eaf6ae1b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:14.734659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-06438bf2-0ee3-410c-ac5e-3cb4eaf6ae1b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:14.735139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-06438bf2-0ee3-410c-ac5e-3cb4eaf6ae1b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:14.736775 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-06438bf2-0ee3-410c-ac5e-3cb4eaf6ae1b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:14.737413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-06438bf2-0ee3-410c-ac5e-3cb4eaf6ae1b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:14.737852 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-06438bf2-0ee3-410c-ac5e-3cb4eaf6ae1b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:14.901259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:14.910944 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:14.912328 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:14.913706 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e9613342-1cc6-4260-9bff-e3610d0b7efd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1746 microversion: 2.20 time: 0.256753 Aug 29 19:14:14.928546 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 482/956] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:14 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1746 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:14.942667 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-06438bf2-0ee3-410c-ac5e-3cb4eaf6ae1b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:14.950732 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-06438bf2-0ee3-410c-ac5e-3cb4eaf6ae1b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1576 microversion: 2.1 time: 0.240127 Aug 29 19:14:14.951520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 475/957] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:14 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:15.273941 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3b71bbfd-1569-4db8-b09b-73451eca7126 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df18d425-5441-4093-b822-991dc7c3fb58"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:15.276540 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3b71bbfd-1569-4db8-b09b-73451eca7126 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:15.283096 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b71bbfd-1569-4db8-b09b-73451eca7126 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:15.283732 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b71bbfd-1569-4db8-b09b-73451eca7126 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:15.284213 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b71bbfd-1569-4db8-b09b-73451eca7126 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:15.284947 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b71bbfd-1569-4db8-b09b-73451eca7126 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:15.285414 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b71bbfd-1569-4db8-b09b-73451eca7126 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:15.285873 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3b71bbfd-1569-4db8-b09b-73451eca7126 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:15.705525 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3b71bbfd-1569-4db8-b09b-73451eca7126 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "POST /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435967 Aug 29 19:14:15.706183 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 483/958] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:14:15 2022] POST /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments => generated 194 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:15.941304 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:15.942657 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:15.953378 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:15.953868 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:15.954476 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:15.955236 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:15.958642 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:15.959114 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:15.976700 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cc4d8299-ce12-405a-8e96-277f2ccdaaed tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:15.977402 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cc4d8299-ce12-405a-8e96-277f2ccdaaed tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:15.990236 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cc4d8299-ce12-405a-8e96-277f2ccdaaed tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:15.990936 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cc4d8299-ce12-405a-8e96-277f2ccdaaed tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:15.991618 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cc4d8299-ce12-405a-8e96-277f2ccdaaed tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:15.994396 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cc4d8299-ce12-405a-8e96-277f2ccdaaed tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:15.994875 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cc4d8299-ce12-405a-8e96-277f2ccdaaed tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:15.995559 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cc4d8299-ce12-405a-8e96-277f2ccdaaed tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:16.506634 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:16.510944 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cc4d8299-ce12-405a-8e96-277f2ccdaaed tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:16.518805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:16.520413 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cc4d8299-ce12-405a-8e96-277f2ccdaaed tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1563 microversion: 2.1 time: 0.549296 Aug 29 19:14:16.520994 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 484/959] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:15 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1563 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:16.530522 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-03cd4f68-ce4b-4a11-b838-c77d1dccd41f req-f4b70110-6cc5-4ffb-9055-0014951e4b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9713d174-1918-4168-b6e7-bf1359b50155", "name": "network-vif-plugged", "status": "completed", "tag": "d4371ad0-840e-40ed-b29d-5fdc435f7837"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:16.542355 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:16.543274 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-03cd4f68-ce4b-4a11-b838-c77d1dccd41f req-f4b70110-6cc5-4ffb-9055-0014951e4b58 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:16.543917 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-03cd4f68-ce4b-4a11-b838-c77d1dccd41f req-f4b70110-6cc5-4ffb-9055-0014951e4b58 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:16.544044 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c716fa07-d39b-4d71-98aa-6b1ecefb7a7c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1741 microversion: 2.20 time: 0.608879 Aug 29 19:14:16.544601 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-03cd4f68-ce4b-4a11-b838-c77d1dccd41f req-f4b70110-6cc5-4ffb-9055-0014951e4b58 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:16.544724 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 476/960] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:15 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1741 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:16.559381 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-03cd4f68-ce4b-4a11-b838-c77d1dccd41f req-f4b70110-6cc5-4ffb-9055-0014951e4b58 service nova] Creating event network-vif-plugged:d4371ad0-840e-40ed-b29d-5fdc435f7837 for instance 9713d174-1918-4168-b6e7-bf1359b50155 on hv-cinder-73126 Aug 29 19:14:16.576404 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-03cd4f68-ce4b-4a11-b838-c77d1dccd41f req-f4b70110-6cc5-4ffb-9055-0014951e4b58 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052153 Aug 29 19:14:16.577055 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 485/961] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:17.575972 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:17.576655 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:17.587518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:17.588362 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:17.589113 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:17.590088 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:17.590834 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:17.591475 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:17.768952 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:17.778438 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:17.780375 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:17.782002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-05695a2f-a249-45fc-be70-7b4b59c96214 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1741 microversion: 2.20 time: 0.211306 Aug 29 19:14:17.783654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 477/962] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:17 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1741 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:18.600677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-15697583-3fb9-4d51-a091-c24f011bf4df req-68ff8050-fa73-4916-8b58-7dc0eb1ef7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337970a7-0d96-4590-bbf0-e7e1b2fae6ac", "name": "network-vif-plugged", "status": "completed", "tag": "bc2fe8d5-1c6f-407b-8613-774dc48866ca"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:18.629289 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-15697583-3fb9-4d51-a091-c24f011bf4df req-68ff8050-fa73-4916-8b58-7dc0eb1ef7dc service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:18.630601 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-15697583-3fb9-4d51-a091-c24f011bf4df req-68ff8050-fa73-4916-8b58-7dc0eb1ef7dc service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:18.631053 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-15697583-3fb9-4d51-a091-c24f011bf4df req-68ff8050-fa73-4916-8b58-7dc0eb1ef7dc service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:18.645435 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-15697583-3fb9-4d51-a091-c24f011bf4df req-68ff8050-fa73-4916-8b58-7dc0eb1ef7dc service nova] Creating event network-vif-plugged:bc2fe8d5-1c6f-407b-8613-774dc48866ca for instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac on hv-cinder-73126 Aug 29 19:14:18.650950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-15697583-3fb9-4d51-a091-c24f011bf4df req-68ff8050-fa73-4916-8b58-7dc0eb1ef7dc service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061527 Aug 29 19:14:18.651944 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 486/963] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:18.812521 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:18.814453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:18.822190 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:18.823053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:18.823803 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:18.826272 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:18.826910 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:18.827846 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:19.034114 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:19.043769 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:19.046135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:19.050374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7583efb3-5c23-4a4f-a3cd-133be9936d3d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1741 microversion: 2.20 time: 0.245919 Aug 29 19:14:19.060228 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 478/964] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:18 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1741 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:20.078550 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:20.080793 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:20.104901 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:20.105833 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:20.106726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:20.107378 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:20.107840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:20.108665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:20.263599 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:20.283339 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:20.285329 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:20.286488 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-77f3a1cb-6169-4e67-9921-cf50ef4824bf tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1741 microversion: 2.20 time: 0.215829 Aug 29 19:14:20.287259 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 487/965] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:20 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:21.310277 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:21.311691 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:21.319366 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:21.320455 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:21.321115 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:21.322134 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:21.322826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:21.323522 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:21.526350 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:21.539430 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:21.541383 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:21.542693 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e642f5b8-ae43-4a42-9caa-51c8937f4620 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1741 microversion: 2.20 time: 0.236877 Aug 29 19:14:21.543461 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 479/966] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:21 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:14:22.570655 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:22.571291 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:22.583781 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:22.584545 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:22.585141 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:22.586008 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:22.586621 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:22.587291 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:22.785216 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:22.794945 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:22.797204 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:22.808517 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-138b9bf5-aad3-4cb5-bb7f-34adccc72b2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1741 microversion: 2.20 time: 0.241692 Aug 29 19:14:22.824163 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 488/967] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:22 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1741 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:23.426610 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f738d587-b02e-40d8-a40e-b23600e15ff4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:23.428798 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f738d587-b02e-40d8-a40e-b23600e15ff4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:23.436379 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f738d587-b02e-40d8-a40e-b23600e15ff4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:23.437237 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f738d587-b02e-40d8-a40e-b23600e15ff4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:23.437846 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f738d587-b02e-40d8-a40e-b23600e15ff4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:23.439430 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f738d587-b02e-40d8-a40e-b23600e15ff4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:23.440112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f738d587-b02e-40d8-a40e-b23600e15ff4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:23.440545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f738d587-b02e-40d8-a40e-b23600e15ff4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:23.464541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:23.484672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f738d587-b02e-40d8-a40e-b23600e15ff4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062381 Aug 29 19:14:23.492488 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 480/968] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:14:23 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments => generated 371 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:23.635347 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b148b032-53ed-4a3d-a219-056b71191c85 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:23.637207 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b148b032-53ed-4a3d-a219-056b71191c85 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:23.647127 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b148b032-53ed-4a3d-a219-056b71191c85 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:23.650263 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b148b032-53ed-4a3d-a219-056b71191c85 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:23.650901 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b148b032-53ed-4a3d-a219-056b71191c85 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:23.651851 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b148b032-53ed-4a3d-a219-056b71191c85 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:23.652482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b148b032-53ed-4a3d-a219-056b71191c85 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:23.653067 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b148b032-53ed-4a3d-a219-056b71191c85 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:23.694308 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b148b032-53ed-4a3d-a219-056b71191c85 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments/cd58edc4-a9c5-4a59-a141-0aca4835532e" status: 200 len: 194 microversion: 2.1 time: 0.063044 Aug 29 19:14:23.695572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 489/969] 10.222.0.94 () {58 vars in 1413 bytes} [Mon Aug 29 19:14:23 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments/cd58edc4-a9c5-4a59-a141-0aca4835532e => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:23.708448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-57173083-1201-4fa0-b940-6d8c884c54b2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:23.708949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-57173083-1201-4fa0-b940-6d8c884c54b2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:23.714978 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-57173083-1201-4fa0-b940-6d8c884c54b2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:23.715674 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-57173083-1201-4fa0-b940-6d8c884c54b2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:23.716325 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-57173083-1201-4fa0-b940-6d8c884c54b2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:23.717343 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-57173083-1201-4fa0-b940-6d8c884c54b2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:23.718512 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-57173083-1201-4fa0-b940-6d8c884c54b2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:23.719524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-57173083-1201-4fa0-b940-6d8c884c54b2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:23.837453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-57173083-1201-4fa0-b940-6d8c884c54b2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lazy-loading 'services' on Instance uuid aa3536f9-d021-4b6f-8cbf-39f78138bccd {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:14:23.841016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:23.841837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:23.857332 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:23.858112 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:23.858728 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:23.859646 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:23.860262 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:23.872012 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:23.958138 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-57173083-1201-4fa0-b940-6d8c884c54b2 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "DELETE /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments/cd58edc4-a9c5-4a59-a141-0aca4835532e" status: 202 len: 0 microversion: 2.1 time: 0.254532 Aug 29 19:14:23.962173 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 481/970] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:14:23 2022] DELETE /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments/cd58edc4-a9c5-4a59-a141-0aca4835532e => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:14:24.090634 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:24.104696 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:24.106252 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:24.107615 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-be0ea7c3-7870-4c8a-bd75-6a35a9931e1c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1741 microversion: 2.20 time: 0.271494 Aug 29 19:14:24.108375 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 490/971] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:23 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1741 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:25.142529 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:25.143399 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:25.150453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:25.151059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:25.151623 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:25.152512 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:25.153069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:25.153595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:25.360408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:25.384756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:25.386959 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:25.389225 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-865eddcc-efc9-4c88-9de5-7bd41b6836d4 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1741 microversion: 2.20 time: 0.255732 Aug 29 19:14:25.391511 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 482/972] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:25 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1741 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:26.169815 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2a8e54c5-c7f9-48e3-b014-f97569bf6f0b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:26.170332 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2a8e54c5-c7f9-48e3-b014-f97569bf6f0b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:26.177095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8e54c5-c7f9-48e3-b014-f97569bf6f0b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:26.177582 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8e54c5-c7f9-48e3-b014-f97569bf6f0b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:26.178027 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8e54c5-c7f9-48e3-b014-f97569bf6f0b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:26.178717 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8e54c5-c7f9-48e3-b014-f97569bf6f0b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:26.179203 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8e54c5-c7f9-48e3-b014-f97569bf6f0b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:26.179629 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2a8e54c5-c7f9-48e3-b014-f97569bf6f0b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:26.210375 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2a8e54c5-c7f9-48e3-b014-f97569bf6f0b tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments/df18d425-5441-4093-b822-991dc7c3fb58" status: 200 len: 194 microversion: 2.1 time: 0.044455 Aug 29 19:14:26.210960 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 491/973] 10.222.0.94 () {58 vars in 1413 bytes} [Mon Aug 29 19:14:26 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments/df18d425-5441-4093-b822-991dc7c3fb58 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:26.221399 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8f08e268-114c-4e36-ac70-6cf786baa5b7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:26.221878 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8f08e268-114c-4e36-ac70-6cf786baa5b7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:26.228948 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f08e268-114c-4e36-ac70-6cf786baa5b7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:26.229433 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f08e268-114c-4e36-ac70-6cf786baa5b7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:26.229871 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f08e268-114c-4e36-ac70-6cf786baa5b7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:26.230559 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f08e268-114c-4e36-ac70-6cf786baa5b7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:26.231014 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f08e268-114c-4e36-ac70-6cf786baa5b7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:26.231463 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8f08e268-114c-4e36-ac70-6cf786baa5b7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:26.313839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-8f08e268-114c-4e36-ac70-6cf786baa5b7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lazy-loading 'services' on Instance uuid aa3536f9-d021-4b6f-8cbf-39f78138bccd {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:14:26.389960 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8f08e268-114c-4e36-ac70-6cf786baa5b7 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "DELETE /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments/df18d425-5441-4093-b822-991dc7c3fb58" status: 202 len: 0 microversion: 2.1 time: 0.172160 Aug 29 19:14:26.390839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 483/974] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:14:26 2022] DELETE /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments/df18d425-5441-4093-b822-991dc7c3fb58 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:14:26.414503 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:26.415249 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:26.421453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:26.421999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:26.422370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:26.423105 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:26.423574 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:26.424006 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:26.579297 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:26.588963 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:26.597604 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:26.597604 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6d0f11a2-d202-44df-bcf4-f554196aca45 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1741 microversion: 2.20 time: 0.181164 Aug 29 19:14:26.597604 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 492/975] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:26 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:27.429338 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-755fd62c-dfb1-4ef2-86b9-aeb5263a522e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:27.430038 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-755fd62c-dfb1-4ef2-86b9-aeb5263a522e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:27.436330 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-755fd62c-dfb1-4ef2-86b9-aeb5263a522e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:27.436955 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-755fd62c-dfb1-4ef2-86b9-aeb5263a522e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:27.437457 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-755fd62c-dfb1-4ef2-86b9-aeb5263a522e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:27.438292 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-755fd62c-dfb1-4ef2-86b9-aeb5263a522e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:27.439374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-755fd62c-dfb1-4ef2-86b9-aeb5263a522e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:27.439806 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-755fd62c-dfb1-4ef2-86b9-aeb5263a522e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:27.465842 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-755fd62c-dfb1-4ef2-86b9-aeb5263a522e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/ips" status: 200 len: 150 microversion: 2.1 time: 0.041126 Aug 29 19:14:27.467002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 484/976] 10.222.0.94 () {58 vars in 1248 bytes} [Mon Aug 29 19:14:27 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:27.613742 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:27.614355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:27.621066 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:27.621930 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:27.622616 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:27.623601 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:27.624317 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:27.625174 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:27.780028 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:27.790791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:27.792560 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:27.793765 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e0aec63d-2321-4b6d-8058-0acfd9c08a23 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1723 microversion: 2.20 time: 0.183993 Aug 29 19:14:27.794406 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 493/977] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:27 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:14:28.626877 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e8ab44ca-2599-44d1-a030-6480c53f262f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:28.629636 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e8ab44ca-2599-44d1-a030-6480c53f262f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:28.636911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ab44ca-2599-44d1-a030-6480c53f262f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:28.646150 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ab44ca-2599-44d1-a030-6480c53f262f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:28.646588 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ab44ca-2599-44d1-a030-6480c53f262f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:28.647339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ab44ca-2599-44d1-a030-6480c53f262f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:28.647833 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ab44ca-2599-44d1-a030-6480c53f262f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:28.648259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e8ab44ca-2599-44d1-a030-6480c53f262f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:28.680024 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e8ab44ca-2599-44d1-a030-6480c53f262f tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058449 Aug 29 19:14:28.680607 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 485/978] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:14:28 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:14:28.801633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-4e6f64a6-4d9a-4a53-a44c-b65ae2aa7b59 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:28.805466 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-4e6f64a6-4d9a-4a53-a44c-b65ae2aa7b59 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:28.811936 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6f64a6-4d9a-4a53-a44c-b65ae2aa7b59 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:28.812423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6f64a6-4d9a-4a53-a44c-b65ae2aa7b59 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:28.812853 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6f64a6-4d9a-4a53-a44c-b65ae2aa7b59 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:28.813801 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6f64a6-4d9a-4a53-a44c-b65ae2aa7b59 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:28.814719 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6f64a6-4d9a-4a53-a44c-b65ae2aa7b59 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:28.815589 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6f64a6-4d9a-4a53-a44c-b65ae2aa7b59 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:28.819832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:28.820449 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:28.827813 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:28.828331 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:28.828972 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:28.829735 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:28.830232 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:28.832795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:28.859539 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-4e6f64a6-4d9a-4a53-a44c-b65ae2aa7b59 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061284 Aug 29 19:14:28.860454 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 494/979] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:14:28 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:14:28.891785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f9293e5d-a85d-4b33-8d9a-780db1f4d34c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eefa548a-61c9-49ae-88ef-693b271353db"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:28.895320 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f9293e5d-a85d-4b33-8d9a-780db1f4d34c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:28.905300 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9293e5d-a85d-4b33-8d9a-780db1f4d34c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:28.906061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9293e5d-a85d-4b33-8d9a-780db1f4d34c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:28.906550 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9293e5d-a85d-4b33-8d9a-780db1f4d34c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:28.907372 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9293e5d-a85d-4b33-8d9a-780db1f4d34c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:28.908470 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9293e5d-a85d-4b33-8d9a-780db1f4d34c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:28.909914 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f9293e5d-a85d-4b33-8d9a-780db1f4d34c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:29.058010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:29.067872 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:29.069450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:29.070652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-df5a6217-a731-4833-a3c4-ac9d6d3bfb0e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1723 microversion: 2.20 time: 0.254812 Aug 29 19:14:29.071243 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 486/980] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:28 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:14:29.075696 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f8c09e6f-0c32-487a-99a3-8a53f24e84de tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:29.076206 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f8c09e6f-0c32-487a-99a3-8a53f24e84de tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:29.082891 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f8c09e6f-0c32-487a-99a3-8a53f24e84de tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:29.083430 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f8c09e6f-0c32-487a-99a3-8a53f24e84de tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:29.083874 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f8c09e6f-0c32-487a-99a3-8a53f24e84de tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:29.084579 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f8c09e6f-0c32-487a-99a3-8a53f24e84de tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:29.085044 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f8c09e6f-0c32-487a-99a3-8a53f24e84de tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:29.085480 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f8c09e6f-0c32-487a-99a3-8a53f24e84de tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:29.111496 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f8c09e6f-0c32-487a-99a3-8a53f24e84de tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Going to try to terminate instance {{(pid=115968) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:14:29.192927 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f8c09e6f-0c32-487a-99a3-8a53f24e84de tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "DELETE /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 204 len: 0 microversion: 2.1 time: 0.120291 Aug 29 19:14:29.193507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 487/981] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:14:29 2022] DELETE /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:14:29.202198 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-50b60ad0-35fa-4053-b727-29c8495d28aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:29.202913 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-50b60ad0-35fa-4053-b727-29c8495d28aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:29.209595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50b60ad0-35fa-4053-b727-29c8495d28aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:29.210285 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50b60ad0-35fa-4053-b727-29c8495d28aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:29.210742 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50b60ad0-35fa-4053-b727-29c8495d28aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:29.211656 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50b60ad0-35fa-4053-b727-29c8495d28aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:29.212111 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50b60ad0-35fa-4053-b727-29c8495d28aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:29.212541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-50b60ad0-35fa-4053-b727-29c8495d28aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:29.365520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-50b60ad0-35fa-4053-b727-29c8495d28aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:29.373678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-50b60ad0-35fa-4053-b727-29c8495d28aa tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1673 microversion: 2.1 time: 0.175603 Aug 29 19:14:29.374670 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 488/982] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:29 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:30.095899 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:30.096626 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:30.103482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:30.103977 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:30.104409 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:30.105114 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:30.105734 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:30.106311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:30.252443 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:30.261197 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:30.262659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:30.263990 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a172319f-ef0d-47c6-9f6b-4f06ae20d794 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1723 microversion: 2.20 time: 0.172306 Aug 29 19:14:30.264411 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 489/983] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:30 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:14:30.306149 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-76f1d83d-64b9-48be-b5d9-2468c19d9fef req-5d7463b2-894d-4475-9604-edca9fc72b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9713d174-1918-4168-b6e7-bf1359b50155", "name": "network-vif-unplugged", "status": "completed", "tag": "d4371ad0-840e-40ed-b29d-5fdc435f7837"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:30.314736 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-76f1d83d-64b9-48be-b5d9-2468c19d9fef req-5d7463b2-894d-4475-9604-edca9fc72b46 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:30.315605 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-76f1d83d-64b9-48be-b5d9-2468c19d9fef req-5d7463b2-894d-4475-9604-edca9fc72b46 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:30.316438 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-76f1d83d-64b9-48be-b5d9-2468c19d9fef req-5d7463b2-894d-4475-9604-edca9fc72b46 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:30.332546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-76f1d83d-64b9-48be-b5d9-2468c19d9fef req-5d7463b2-894d-4475-9604-edca9fc72b46 service nova] Creating event network-vif-unplugged:d4371ad0-840e-40ed-b29d-5fdc435f7837 for instance 9713d174-1918-4168-b6e7-bf1359b50155 on hv-cinder-73126 Aug 29 19:14:30.338167 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-76f1d83d-64b9-48be-b5d9-2468c19d9fef req-5d7463b2-894d-4475-9604-edca9fc72b46 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039238 Aug 29 19:14:30.339437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 490/984] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:14:30.398384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-59ae3461-2991-4827-ae2e-c870914f8c65 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:30.399149 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-59ae3461-2991-4827-ae2e-c870914f8c65 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:30.405241 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-59ae3461-2991-4827-ae2e-c870914f8c65 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:30.405729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-59ae3461-2991-4827-ae2e-c870914f8c65 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:30.406164 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-59ae3461-2991-4827-ae2e-c870914f8c65 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:30.406857 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-59ae3461-2991-4827-ae2e-c870914f8c65 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:30.407418 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-59ae3461-2991-4827-ae2e-c870914f8c65 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:30.407902 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-59ae3461-2991-4827-ae2e-c870914f8c65 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:30.545152 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-59ae3461-2991-4827-ae2e-c870914f8c65 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:30.553807 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-59ae3461-2991-4827-ae2e-c870914f8c65 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1673 microversion: 2.1 time: 0.160880 Aug 29 19:14:30.554357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 491/985] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:30 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:31.288862 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:31.289761 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:31.298951 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:31.299666 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:31.300286 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:31.301034 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:31.301478 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:31.302106 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:31.460951 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:31.472393 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:31.474365 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:31.476811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-cd011546-8822-4547-8f20-1378bfeebca6 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1723 microversion: 2.20 time: 0.192911 Aug 29 19:14:31.477752 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 492/986] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:31 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:31.575955 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5542fd29-fca8-4f67-b412-141127e9ab62 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:31.578939 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5542fd29-fca8-4f67-b412-141127e9ab62 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:31.588210 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5542fd29-fca8-4f67-b412-141127e9ab62 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:31.588913 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5542fd29-fca8-4f67-b412-141127e9ab62 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:31.589359 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5542fd29-fca8-4f67-b412-141127e9ab62 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:31.590081 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5542fd29-fca8-4f67-b412-141127e9ab62 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:31.590539 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5542fd29-fca8-4f67-b412-141127e9ab62 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:31.590963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5542fd29-fca8-4f67-b412-141127e9ab62 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:31.633467 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:31.674714 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f9293e5d-a85d-4b33-8d9a-780db1f4d34c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "POST /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.793823 Aug 29 19:14:31.676190 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 495/987] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:14:28 2022] POST /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments => generated 194 bytes in 2797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:14:31.847821 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5542fd29-fca8-4f67-b412-141127e9ab62 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:31.875031 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5542fd29-fca8-4f67-b412-141127e9ab62 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1673 microversion: 2.1 time: 0.302570 Aug 29 19:14:31.875880 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 493/988] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:31 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:32.502442 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:32.503157 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:32.505300 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=56 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:32.510673 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:32.511979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:32.512415 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:32.513114 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:32.513568 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:32.513989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:32.733569 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:32.747508 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:32.749316 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:32.750450 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cb661d68-7d82-47a1-9d0e-87848bc6485f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1666 microversion: 2.20 time: 0.253027 Aug 29 19:14:32.751102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 496/989] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:32 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1666 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:32.775744 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-63db5b58-5c6a-44b2-b489-357d03b0381b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22256c8c-c5e7-44d0-84e9-f68088bed55c"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:32.779449 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-63db5b58-5c6a-44b2-b489-357d03b0381b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:32.782478 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:32.792035 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-63db5b58-5c6a-44b2-b489-357d03b0381b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:32.793726 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-63db5b58-5c6a-44b2-b489-357d03b0381b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:32.794875 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-63db5b58-5c6a-44b2-b489-357d03b0381b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:32.797972 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-63db5b58-5c6a-44b2-b489-357d03b0381b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:32.800009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-63db5b58-5c6a-44b2-b489-357d03b0381b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:32.800676 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-63db5b58-5c6a-44b2-b489-357d03b0381b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:32.826144 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-9620b632-3d58-4959-8574-155c09d90c73 req-a2718b78-3c3a-4304-aa4e-ed33fc3f104b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3536f9-d021-4b6f-8cbf-39f78138bccd", "name": "network-vif-deleted", "tag": "86571d83-f032-4925-a522-e017c5c41946"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:32.843688 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-9620b632-3d58-4959-8574-155c09d90c73 req-a2718b78-3c3a-4304-aa4e-ed33fc3f104b service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:32.844179 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-9620b632-3d58-4959-8574-155c09d90c73 req-a2718b78-3c3a-4304-aa4e-ed33fc3f104b service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:32.844609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-9620b632-3d58-4959-8574-155c09d90c73 req-a2718b78-3c3a-4304-aa4e-ed33fc3f104b service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:32.865909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-9620b632-3d58-4959-8574-155c09d90c73 req-a2718b78-3c3a-4304-aa4e-ed33fc3f104b service nova] Creating event network-vif-deleted:86571d83-f032-4925-a522-e017c5c41946 for instance aa3536f9-d021-4b6f-8cbf-39f78138bccd on hv-cinder-73126 Aug 29 19:14:32.873035 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-9620b632-3d58-4959-8574-155c09d90c73 req-a2718b78-3c3a-4304-aa4e-ed33fc3f104b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050733 Aug 29 19:14:32.873649 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 497/990] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:32.904696 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-26498a44-3b06-41f5-85ac-5c5833b018b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:32.905407 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-26498a44-3b06-41f5-85ac-5c5833b018b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:32.914847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-26498a44-3b06-41f5-85ac-5c5833b018b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:32.915579 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-26498a44-3b06-41f5-85ac-5c5833b018b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:32.916268 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-26498a44-3b06-41f5-85ac-5c5833b018b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:32.917127 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-26498a44-3b06-41f5-85ac-5c5833b018b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:32.917744 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-26498a44-3b06-41f5-85ac-5c5833b018b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:32.918331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-26498a44-3b06-41f5-85ac-5c5833b018b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:32.927879 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:33.017451 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-26498a44-3b06-41f5-85ac-5c5833b018b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624a0a90866446439918bd65ce5ddc60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dda60c835244f5f9c980ed1927d9784', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:33.026644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-26498a44-3b06-41f5-85ac-5c5833b018b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 200 len: 1322 microversion: 2.1 time: 0.126031 Aug 29 19:14:33.027767 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 498/991] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:32 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 1322 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:33.208416 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-63db5b58-5c6a-44b2-b489-357d03b0381b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "POST /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.437749 Aug 29 19:14:33.209040 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 494/992] 10.222.0.94 () {62 vars in 1364 bytes} [Mon Aug 29 19:14:32 2022] POST /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/os-volume_attachments => generated 188 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 19:14:33.346490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-226fb27b-6782-438a-8ddd-c3c3102397c1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:33.347238 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-226fb27b-6782-438a-8ddd-c3c3102397c1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:33.354575 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-226fb27b-6782-438a-8ddd-c3c3102397c1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:33.355116 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-226fb27b-6782-438a-8ddd-c3c3102397c1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:33.355802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-226fb27b-6782-438a-8ddd-c3c3102397c1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:33.356922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-226fb27b-6782-438a-8ddd-c3c3102397c1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:33.357381 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-226fb27b-6782-438a-8ddd-c3c3102397c1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:33.357991 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-226fb27b-6782-438a-8ddd-c3c3102397c1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:33.456902 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-152721458", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "networks": [{"uuid": "3fdbe9fa-77da-455d-95a7-01c7fcef80b3"}]}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:33.517867 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.network.neutron [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] validate_networks() for [('3fdbe9fa-77da-455d-95a7-01c7fcef80b3', None, None, None, None, None)] {{(pid=115968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:14:33.665607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-226fb27b-6782-438a-8ddd-c3c3102397c1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "DELETE /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/os-volume_attachments/22256c8c-c5e7-44d0-84e9-f68088bed55c" status: 202 len: 0 microversion: 2.20 time: 0.323468 Aug 29 19:14:33.666582 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 499/993] 10.222.0.94 () {60 vars in 1457 bytes} [Mon Aug 29 19:14:33 2022] DELETE /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/os-volume_attachments/22256c8c-c5e7-44d0-84e9-f68088bed55c => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:14:33.754339 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-83803fd8-8675-4d8c-a757-16790edd54d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:33.755158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-83803fd8-8675-4d8c-a757-16790edd54d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:33.761012 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83803fd8-8675-4d8c-a757-16790edd54d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:33.761499 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83803fd8-8675-4d8c-a757-16790edd54d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:33.761950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83803fd8-8675-4d8c-a757-16790edd54d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:33.762839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83803fd8-8675-4d8c-a757-16790edd54d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:33.763660 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83803fd8-8675-4d8c-a757-16790edd54d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:33.764095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-83803fd8-8675-4d8c-a757-16790edd54d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:33.824698 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-83803fd8-8675-4d8c-a757-16790edd54d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=115967) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 19:14:33.909950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-83803fd8-8675-4d8c-a757-16790edd54d1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "POST /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/action" status: 202 len: 0 microversion: 2.20 time: 0.160420 Aug 29 19:14:33.910562 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 500/994] 10.222.0.94 () {62 vars in 1319 bytes} [Mon Aug 29 19:14:33 2022] POST /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 29 19:14:33.922701 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:33.923713 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:33.930671 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:33.931550 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:33.932198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:33.933068 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:33.933879 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:33.934602 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:34.083911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Flavor limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:14:34.085071 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Image limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:14:34.086133 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Flavor pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:14:34.086133 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Image pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:14:34.086481 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:14:34.101214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:34.101711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:34.102151 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:34.102885 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:34.103379 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:34.103812 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:34.113379 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:34.122046 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:34.122621 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Getting quotas for project abcda882db7046eab245492bc4c4d7e6. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:14:34.123753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:34.125037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-62c60bfb-d995-4f29-b8f3-f98c492b7303 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1674 microversion: 2.20 time: 0.209686 Aug 29 19:14:34.126029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 501/995] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:33 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1674 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:34.129480 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Getting quotas for user bccc502170e349e0848922712c574ca7 and project abcda882db7046eab245492bc4c4d7e6. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:14:34.130841 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:34.131491 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:34.137822 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:34.138316 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:34.138756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:34.139493 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:34.139955 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:34.140407 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:34.150072 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Going to run 1 instances... {{(pid=115968) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:14:34.152574 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:14:34.154798 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] HTTP exception thrown: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Request method failure captured: Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd HTTP/1.1 Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6E9_4bd8q-CHhO9dy-p4ywD7JjoK6Oszu36lBhBD1sKyZbtqt-MBL4Nu5qNHCe92fKQKfp6sQsbRRXhh9lBRBr_-rnIS6bgsShiru9yuUDeVe4AwsogoGD5COMRhcmwSYuP3eQ8IuECwXB1HwmhA8H-JhkzoUU-dIWB7GRt0YHxso Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:14:34.156474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}] Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 624a0a90866446439918bd65ce5ddc60 Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:34.158843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': 'aa3536f9-d021-4b6f-8cbf-39f78138bccd'} Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:34.159753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:34.161038 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:34.162197 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Returning 404 to user: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:34.162197 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6be9b4d8-c5c4-463c-bbbd-29578a97e7d4 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 404 len: 111 microversion: 2.1 time: 0.031508 Aug 29 19:14:34.162197 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 502/996] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:34 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:14:34.168032 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-4ae3555d-7fab-42dc-8baa-a0123855d0b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '.version_select at 0x7f3d7625a280>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:34.188282 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-4ae3555d-7fab-42dc-8baa-a0123855d0b9 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934521491" status: 202 len: 0 microversion: 2.1 time: 0.023894 Aug 29 19:14:34.189563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 503/997] 10.222.0.94 () {58 vars in 1221 bytes} [Mon Aug 29 19:14:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1934521491 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:14:34.207439 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-23a2440f-a96f-48ff-a3e3-7d231c582cef tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759768 Aug 29 19:14:34.208044 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 495/998] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 19:14:34.219014 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bdd3a31c-14a0-4c6b-9825-6d44c47f4a21 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:34.220319 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bdd3a31c-14a0-4c6b-9825-6d44c47f4a21 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:34.320279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-bdd3a31c-14a0-4c6b-9825-6d44c47f4a21 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:34.337983 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bdd3a31c-14a0-4c6b-9825-6d44c47f4a21 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1213 microversion: 2.1 time: 0.120830 Aug 29 19:14:34.338933 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 504/999] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:34 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:35.149053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:35.149665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:35.155751 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:35.156220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:35.156656 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:35.157341 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:35.158347 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:35.158779 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:35.293601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:35.303198 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:35.304613 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:35.306030 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-566920b2-9d12-47ab-83fd-976cf8fb9c78 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.161413 Aug 29 19:14:35.306600 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 496/1000] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:35 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:35.359370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2a5df651-3dc6-4ff2-ae54-c1982102fdbd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:35.360026 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2a5df651-3dc6-4ff2-ae54-c1982102fdbd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:35.433550 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2a5df651-3dc6-4ff2-ae54-c1982102fdbd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:35.441230 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2a5df651-3dc6-4ff2-ae54-c1982102fdbd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1213 microversion: 2.1 time: 0.085818 Aug 29 19:14:35.441802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 505/1001] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:35 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:36.330982 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:36.331662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:36.338033 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:36.338518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:36.338951 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:36.339764 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:36.340221 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:36.340646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:36.464429 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-89397472-bb59-4bf4-92ae-b72af4b44c1e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:36.465520 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-89397472-bb59-4bf4-92ae-b72af4b44c1e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:36.484121 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89397472-bb59-4bf4-92ae-b72af4b44c1e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:36.487308 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89397472-bb59-4bf4-92ae-b72af4b44c1e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:36.488205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89397472-bb59-4bf4-92ae-b72af4b44c1e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:36.489352 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89397472-bb59-4bf4-92ae-b72af4b44c1e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:36.489993 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89397472-bb59-4bf4-92ae-b72af4b44c1e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:36.490426 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-89397472-bb59-4bf4-92ae-b72af4b44c1e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:36.490861 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:36.508374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:36.510675 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:36.512529 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5a5c4e88-984a-43c3-af8d-0040e984d15e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.185378 Aug 29 19:14:36.513635 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 497/1002] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:36 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:36.592910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-89397472-bb59-4bf4-92ae-b72af4b44c1e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:36.603166 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-89397472-bb59-4bf4-92ae-b72af4b44c1e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1265 microversion: 2.1 time: 0.144695 Aug 29 19:14:36.604022 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 506/1003] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:36 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:37.175956 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:37.176537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:37.182881 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:37.183665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:37.184168 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:37.184932 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:37.185392 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:37.185809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:37.199730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] HTTP exception thrown: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Request method failure captured: Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: DELETE /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd HTTP/1.1 Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6E9_4bd8q-CHhO9dy-p4ywD7JjoK6Oszu36lBhBD1sKyZbtqt-MBL4Nu5qNHCe92fKQKfp6sQsbRRXhh9lBRBr_-rnIS6bgsShiru9yuUDeVe4AwsogoGD5COMRhcmwSYuP3eQ8IuECwXB1HwmhA8H-JhkzoUU-dIWB7GRt0YHxso Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:14:37.201437 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}] Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 624a0a90866446439918bd65ce5ddc60 Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:37.202786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': 'aa3536f9-d021-4b6f-8cbf-39f78138bccd'} Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:37.203823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:37.205760 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:37.207946 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Returning 404 to user: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:37.207946 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a71300b8-bb03-49bd-a860-81679140a4c3 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "DELETE /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 404 len: 111 microversion: 2.1 time: 0.031717 Aug 29 19:14:37.207946 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 498/1004] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:14:37 2022] DELETE /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:14:37.214811 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:37.215464 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: aa3536f9-d021-4b6f-8cbf-39f78138bccd] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:37.225068 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:37.225608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:37.226071 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:37.226786 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:37.227271 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:37.227697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:37.244765 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] HTTP exception thrown: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Request method failure captured: Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd HTTP/1.1 Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6E9_4bd8q-CHhO9dy-p4ywD7JjoK6Oszu36lBhBD1sKyZbtqt-MBL4Nu5qNHCe92fKQKfp6sQsbRRXhh9lBRBr_-rnIS6bgsShiru9yuUDeVe4AwsogoGD5COMRhcmwSYuP3eQ8IuECwXB1HwmhA8H-JhkzoUU-dIWB7GRt0YHxso Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:14:37.246299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}] Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 624a0a90866446439918bd65ce5ddc60 Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:37.247989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': 'aa3536f9-d021-4b6f-8cbf-39f78138bccd'} Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:37.248902 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. Aug 29 19:14:37.250480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:37.251997 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Returning 404 to user: Instance aa3536f9-d021-4b6f-8cbf-39f78138bccd could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:37.251997 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-4e6eee78-6388-4b33-a4ea-e84351cd220c tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd" status: 404 len: 111 microversion: 2.1 time: 0.039339 Aug 29 19:14:37.251997 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 507/1005] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:37 2022] GET /compute/v2.1/servers/aa3536f9-d021-4b6f-8cbf-39f78138bccd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:14:37.537137 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:37.537757 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:37.544950 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:37.545566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:37.546269 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:37.546974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:37.547469 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:37.547899 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:37.629724 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2234a790-6b9e-4abf-97cb-b8bb4aa7cbb5 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:37.632020 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2234a790-6b9e-4abf-97cb-b8bb4aa7cbb5 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:37.641482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2234a790-6b9e-4abf-97cb-b8bb4aa7cbb5 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:37.642129 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2234a790-6b9e-4abf-97cb-b8bb4aa7cbb5 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:37.642570 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2234a790-6b9e-4abf-97cb-b8bb4aa7cbb5 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:37.643617 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2234a790-6b9e-4abf-97cb-b8bb4aa7cbb5 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:37.644079 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2234a790-6b9e-4abf-97cb-b8bb4aa7cbb5 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:37.644511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2234a790-6b9e-4abf-97cb-b8bb4aa7cbb5 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:37.704107 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:37.715805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:37.717475 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:37.718950 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d8307119-0c02-45cd-a0cb-1785d732648e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.185793 Aug 29 19:14:37.723506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 499/1006] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:37 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:37.740302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2234a790-6b9e-4abf-97cb-b8bb4aa7cbb5 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:37.752102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2234a790-6b9e-4abf-97cb-b8bb4aa7cbb5 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1265 microversion: 2.1 time: 0.130498 Aug 29 19:14:37.752832 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 508/1007] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:37 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:38.400838 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:38.401695 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:38.408304 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:38.408897 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:38.409397 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:38.410203 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:38.410669 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:38.411121 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:38.426397 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] HTTP exception thrown: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Request method failure captured: Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: DELETE /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 HTTP/1.1 Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6E9_4bd8q-CHhO9dy-p4ywD7JjoK6Oszu36lBhBD1sKyZbtqt-MBL4Nu5qNHCe92fKQKfp6sQsbRRXhh9lBRBr_-rnIS6bgsShiru9yuUDeVe4AwsogoGD5COMRhcmwSYuP3eQ8IuECwXB1HwmhA8H-JhkzoUU-dIWB7GRt0YHxso Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:14:38.428003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}] Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 624a0a90866446439918bd65ce5ddc60 Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:14:38.429616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '22f96567-e842-4352-9e40-e31d2f547937'} Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:38.430482 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:14:38.431773 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:38.433107 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Returning 404 to user: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:38.433107 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2a81e207-0c8b-45e7-946a-72d28b0d098d tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "DELETE /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 404 len: 111 microversion: 2.1 time: 0.032487 Aug 29 19:14:38.433462 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 500/1008] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:14:38 2022] DELETE /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:14:38.438687 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:38.440345 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] [instance: 22f96567-e842-4352-9e40-e31d2f547937] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:38.446788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:38.447420 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:38.447925 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:38.448690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:38.449216 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:38.449708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:38.464093 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] HTTP exception thrown: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Request method failure captured: Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 HTTP/1.1 Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6E9_4bd8q-CHhO9dy-p4ywD7JjoK6Oszu36lBhBD1sKyZbtqt-MBL4Nu5qNHCe92fKQKfp6sQsbRRXhh9lBRBr_-rnIS6bgsShiru9yuUDeVe4AwsogoGD5COMRhcmwSYuP3eQ8IuECwXB1HwmhA8H-JhkzoUU-dIWB7GRt0YHxso Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:14:38.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/5dda60c835244f5f9c980ed1927d9784"}]}] Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 5dda60c835244f5f9c980ed1927d9784 Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-AttachVolumeTestJSON-247347552 Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 624a0a90866446439918bd65ce5ddc60 Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-AttachVolumeTestJSON-247347552-project Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:14:38.468418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '22f96567-e842-4352-9e40-e31d2f547937'} Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:38.469147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. Aug 29 19:14:38.471257 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:14:38.472704 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] Returning 404 to user: Instance 22f96567-e842-4352-9e40-e31d2f547937 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:38.472704 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-82a307dd-6f2f-4f31-b3e6-a6eefcf53e13 tempest-AttachVolumeTestJSON-247347552 tempest-AttachVolumeTestJSON-247347552-project] 10.222.0.94 "GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937" status: 404 len: 111 microversion: 2.1 time: 0.032238 Aug 29 19:14:38.472704 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 509/1009] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:38 2022] GET /compute/v2.1/servers/22f96567-e842-4352-9e40-e31d2f547937 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:14:38.746021 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:38.746634 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:38.755233 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:38.755892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:38.756428 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:38.757269 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:38.757826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:38.758355 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:38.774389 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8eb50a9e-6c98-4c6f-b9ae-ad32632933af tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:38.775809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8eb50a9e-6c98-4c6f-b9ae-ad32632933af tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:38.784511 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8eb50a9e-6c98-4c6f-b9ae-ad32632933af tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:38.785318 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8eb50a9e-6c98-4c6f-b9ae-ad32632933af tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:38.789446 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8eb50a9e-6c98-4c6f-b9ae-ad32632933af tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:38.790939 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8eb50a9e-6c98-4c6f-b9ae-ad32632933af tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:38.791607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8eb50a9e-6c98-4c6f-b9ae-ad32632933af tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:38.792046 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8eb50a9e-6c98-4c6f-b9ae-ad32632933af tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:39.029000 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8eb50a9e-6c98-4c6f-b9ae-ad32632933af tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:39.039140 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8eb50a9e-6c98-4c6f-b9ae-ad32632933af tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1265 microversion: 2.1 time: 0.268864 Aug 29 19:14:39.042975 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 510/1010] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:38 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:39.140680 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:39.149780 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:39.151278 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:39.152452 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-89b88cca-2cf7-4e42-9410-da9f6132fbbe tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.410497 Aug 29 19:14:39.153013 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 501/1011] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:38 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:40.065356 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-78ebc537-8f9a-4279-bf07-1568bcc6e1d0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:40.066576 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-78ebc537-8f9a-4279-bf07-1568bcc6e1d0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:40.073681 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78ebc537-8f9a-4279-bf07-1568bcc6e1d0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:40.074681 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78ebc537-8f9a-4279-bf07-1568bcc6e1d0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:40.075674 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78ebc537-8f9a-4279-bf07-1568bcc6e1d0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:40.076570 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78ebc537-8f9a-4279-bf07-1568bcc6e1d0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:40.077201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78ebc537-8f9a-4279-bf07-1568bcc6e1d0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:40.077622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78ebc537-8f9a-4279-bf07-1568bcc6e1d0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:40.174861 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-78ebc537-8f9a-4279-bf07-1568bcc6e1d0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:40.184470 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-78ebc537-8f9a-4279-bf07-1568bcc6e1d0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1265 microversion: 2.1 time: 0.124265 Aug 29 19:14:40.184723 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:40.185260 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:40.193741 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:40.194472 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:40.195052 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:40.195958 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:40.196613 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:40.197195 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:40.199661 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 511/1012] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:40 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:40.459228 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:40.479434 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:40.481456 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:40.486217 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-4ccc09c0-6f0b-49e4-9f3f-1b92d5ba5e14 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.306108 Aug 29 19:14:40.487627 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 502/1013] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:40 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:14:41.207175 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1ca734e3-2237-4a91-8c8f-f2ed496db03e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:41.207798 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1ca734e3-2237-4a91-8c8f-f2ed496db03e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:41.224836 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ca734e3-2237-4a91-8c8f-f2ed496db03e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:41.224836 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ca734e3-2237-4a91-8c8f-f2ed496db03e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:41.226382 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ca734e3-2237-4a91-8c8f-f2ed496db03e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:41.226870 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ca734e3-2237-4a91-8c8f-f2ed496db03e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:41.227357 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ca734e3-2237-4a91-8c8f-f2ed496db03e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:41.230256 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1ca734e3-2237-4a91-8c8f-f2ed496db03e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:41.335945 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1ca734e3-2237-4a91-8c8f-f2ed496db03e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:41.343837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1ca734e3-2237-4a91-8c8f-f2ed496db03e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1265 microversion: 2.1 time: 0.141830 Aug 29 19:14:41.351635 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 512/1014] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:41 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:41.510433 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:41.511186 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:41.519250 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:41.520340 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:41.521259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:41.522251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:41.523063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:41.523641 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:41.804849 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:41.820156 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:41.827360 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:41.831909 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5980fceb-b4bc-4637-9689-1338e054ff54 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.325692 Aug 29 19:14:41.848514 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 503/1015] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:41 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:42.369200 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e6611b1f-700d-43c5-b2b9-120febe42e2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:42.371306 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e6611b1f-700d-43c5-b2b9-120febe42e2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:42.386716 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6611b1f-700d-43c5-b2b9-120febe42e2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:42.387617 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6611b1f-700d-43c5-b2b9-120febe42e2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:42.389198 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6611b1f-700d-43c5-b2b9-120febe42e2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:42.398817 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6611b1f-700d-43c5-b2b9-120febe42e2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:42.399724 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6611b1f-700d-43c5-b2b9-120febe42e2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:42.400433 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6611b1f-700d-43c5-b2b9-120febe42e2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:42.677887 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e6611b1f-700d-43c5-b2b9-120febe42e2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:42.686286 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e6611b1f-700d-43c5-b2b9-120febe42e2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1265 microversion: 2.1 time: 0.324245 Aug 29 19:14:42.686864 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 513/1016] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:42 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1265 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:42.857829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:42.858453 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:42.878563 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:42.879105 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:42.879540 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:42.880267 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:42.880728 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:42.881159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:43.113630 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:43.125826 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:43.128247 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:43.129640 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a25d5964-8ab8-4050-b210-9ba3a7e44418 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.275564 Aug 29 19:14:43.131288 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 504/1017] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:42 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:43.708266 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-64f0596a-3b43-4bb1-8a19-86f526775bfe tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:43.708893 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-64f0596a-3b43-4bb1-8a19-86f526775bfe tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:43.719797 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-64f0596a-3b43-4bb1-8a19-86f526775bfe tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:43.721189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-64f0596a-3b43-4bb1-8a19-86f526775bfe tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:43.721302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-64f0596a-3b43-4bb1-8a19-86f526775bfe tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:43.722017 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-64f0596a-3b43-4bb1-8a19-86f526775bfe tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:43.722610 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-64f0596a-3b43-4bb1-8a19-86f526775bfe tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:43.725136 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-64f0596a-3b43-4bb1-8a19-86f526775bfe tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:43.757340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:43.842387 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-64f0596a-3b43-4bb1-8a19-86f526775bfe tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:43.853537 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-64f0596a-3b43-4bb1-8a19-86f526775bfe tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1265 microversion: 2.1 time: 0.149026 Aug 29 19:14:43.867962 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 514/1018] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:43 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:44.156051 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:44.157523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:44.161035 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:44.162144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=6 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:44.166833 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:44.167752 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:44.168464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:44.169611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:44.170289 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:44.170931 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:44.338250 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:44.351332 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:44.353039 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:44.354438 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3246c4f1-5ccf-4adc-9143-4aa72d3e2b9d tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.202623 Aug 29 19:14:44.354996 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 505/1019] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:44 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:44.387293 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a91bdf8c-13a3-4c88-af4c-3bac2e8555be tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] Action: 'create', calling method: .version_select at 0x7f3d7623eca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-908117722", "metadata": {"Type": "work"}}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:44.780285 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a91bdf8c-13a3-4c88-af4c-3bac2e8555be tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.561162 Aug 29 19:14:44.781177 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 515/1020] 10.222.0.94 () {60 vars in 1156 bytes} [Mon Aug 29 19:14:44 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 563 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 29 19:14:44.794308 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2889dda4-24a3-4b2e-a20e-bdf07a470305 tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] Calling method '.version_select at 0x7f3d764893a0>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:44.875408 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-380459bd-ce94-4c20-9bf1-71ca7d03794e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:44.876037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-380459bd-ce94-4c20-9bf1-71ca7d03794e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:44.886309 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2889dda4-24a3-4b2e-a20e-bdf07a470305 tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c" status: 200 len: 352 microversion: 2.1 time: 0.095936 Aug 29 19:14:44.891817 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 506/1021] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:14:44 2022] GET /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:44.892327 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-380459bd-ce94-4c20-9bf1-71ca7d03794e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:44.893364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-380459bd-ce94-4c20-9bf1-71ca7d03794e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:44.894068 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-380459bd-ce94-4c20-9bf1-71ca7d03794e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:44.895540 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-380459bd-ce94-4c20-9bf1-71ca7d03794e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:44.896242 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-380459bd-ce94-4c20-9bf1-71ca7d03794e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:44.896950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-380459bd-ce94-4c20-9bf1-71ca7d03794e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:44.968751 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-380459bd-ce94-4c20-9bf1-71ca7d03794e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:44.977736 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-380459bd-ce94-4c20-9bf1-71ca7d03794e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1265 microversion: 2.1 time: 0.106457 Aug 29 19:14:44.978559 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 516/1022] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:44 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:45.379523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:45.380266 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:45.386227 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:45.386706 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:45.387294 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:45.387982 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:45.388433 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:45.388854 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:45.526971 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:45.535818 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:45.537265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:45.538418 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c8664ca4-5d60-4d07-8ea1-e23b86d76827 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.163921 Aug 29 19:14:45.538976 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 507/1023] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:45 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:14:45.899496 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d3a1740b-86dd-4d9c-97a8-304ca2e2876d tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] Calling method '.version_select at 0x7f3d761efaf0>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:45.905794 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=4 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:45.951725 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d3a1740b-86dd-4d9c-97a8-304ca2e2876d tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c" status: 200 len: 353 microversion: 2.1 time: 0.056132 Aug 29 19:14:45.952886 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 517/1024] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:14:45 2022] GET /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:45.965489 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-30c6e61d-f5f1-4011-8c82-2f65e3fbdc65 tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] Calling method '.version_select at 0x7f3d76457700>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:45.998260 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d07e7d27-2529-46c3-82b5-5047f041f5fc tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:45.998878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d07e7d27-2529-46c3-82b5-5047f041f5fc tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:46.005437 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d07e7d27-2529-46c3-82b5-5047f041f5fc tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:46.005941 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d07e7d27-2529-46c3-82b5-5047f041f5fc tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:46.006381 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d07e7d27-2529-46c3-82b5-5047f041f5fc tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:46.007147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d07e7d27-2529-46c3-82b5-5047f041f5fc tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:46.007612 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d07e7d27-2529-46c3-82b5-5047f041f5fc tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:46.008048 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d07e7d27-2529-46c3-82b5-5047f041f5fc tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:46.014984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-30c6e61d-f5f1-4011-8c82-2f65e3fbdc65 tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c" status: 200 len: 353 microversion: 2.1 time: 0.053423 Aug 29 19:14:46.015633 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 508/1025] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:14:45 2022] GET /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:46.033777 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f007ed36-3736-49cf-b956-0bb92d490d2d tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] Calling method '.version_select at 0x7f3d764898b0>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:46.075808 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d07e7d27-2529-46c3-82b5-5047f041f5fc tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:46.084664 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d07e7d27-2529-46c3-82b5-5047f041f5fc tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1273 microversion: 2.1 time: 0.090070 Aug 29 19:14:46.085212 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 518/1026] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:45 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1273 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:46.110447 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f007ed36-3736-49cf-b956-0bb92d490d2d tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c" status: 202 len: 0 microversion: 2.1 time: 0.080925 Aug 29 19:14:46.111229 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 509/1027] 10.222.0.94 () {58 vars in 1248 bytes} [Mon Aug 29 19:14:46 2022] DELETE /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:14:46.124072 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ffa790d3-9124-4a2a-93f9-f742398da79f tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] Calling method '.version_select at 0x7f3d764a80d0>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:46.172210 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ffa790d3-9124-4a2a-93f9-f742398da79f tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c" status: 200 len: 352 microversion: 2.1 time: 0.052054 Aug 29 19:14:46.172800 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 519/1028] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:14:46 2022] GET /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:46.562351 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:46.562957 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:46.569854 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:46.570353 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:46.570765 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:46.571477 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:46.571950 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:46.572369 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:46.704157 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:46.712393 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:46.713834 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:46.714978 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-feff1e46-c863-4158-8f8d-e46949d641d8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.157095 Aug 29 19:14:46.715560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 510/1029] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:46 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:14:47.116777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7508ee96-97d8-466d-aea0-cdbb08315bc9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:47.117395 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7508ee96-97d8-466d-aea0-cdbb08315bc9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:47.123426 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7508ee96-97d8-466d-aea0-cdbb08315bc9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:47.123922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7508ee96-97d8-466d-aea0-cdbb08315bc9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:47.124364 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7508ee96-97d8-466d-aea0-cdbb08315bc9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:47.125059 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7508ee96-97d8-466d-aea0-cdbb08315bc9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:47.125522 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7508ee96-97d8-466d-aea0-cdbb08315bc9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:47.125946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7508ee96-97d8-466d-aea0-cdbb08315bc9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:47.185766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f3153fac-8efc-4a87-b341-f9a3c268d3ea tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] Calling method '.version_select at 0x7f3d764894c0>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:47.187236 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7508ee96-97d8-466d-aea0-cdbb08315bc9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:47.195944 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7508ee96-97d8-466d-aea0-cdbb08315bc9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1283 microversion: 2.1 time: 0.083582 Aug 29 19:14:47.196530 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 520/1030] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:47 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1283 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:47.214329 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-f3153fac-8efc-4a87-b341-f9a3c268d3ea tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] HTTP exception thrown: Volume 65ea2064-5521-4de2-9efa-0410b8733a4c could not be found. Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f3153fac-8efc-4a87-b341-f9a3c268d3ea tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] Request method failure captured: Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c HTTP/1.1 Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDRAk1Pl5-NKUy8XT86SaGfjNdOQv7cpwMWcOClK080Wb5ZQmsb4drDdJMWXY3sdqJpDv-tQfCudymY61cOfoVILowYeoca5f8WtRagxgKi5Z9HYTyPVHFEI3vW6YXPZyB428Fr-Up2WhLDasINo3YZbtTG1aciSV6f9_lnULz4gSPUw Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 6da02c0b0e5f4892b3c15c96a3209b62 Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-VolumesGetTestJSON-28385180 Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:14:47.216346 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6da02c0b0e5f4892b3c15c96a3209b62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6da02c0b0e5f4892b3c15c96a3209b62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6da02c0b0e5f4892b3c15c96a3209b62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6da02c0b0e5f4892b3c15c96a3209b62"}]}] Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-VolumesGetTestJSON-28385180 Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 6da02c0b0e5f4892b3c15c96a3209b62 Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-VolumesGetTestJSON-28385180 Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-VolumesGetTestJSON-28385180-project Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 3dc909fb80804fc483d12d79df5a96e9 Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-VolumesGetTestJSON-28385180-project Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Volume 65ea2064-5521-4de2-9efa-0410b8733a4c could not be found. Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '65ea2064-5521-4de2-9efa-0410b8733a4c'} Aug 29 19:14:47.218059 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 65ea2064-5521-4de2-9efa-0410b8733a4c could not be found. (HTTP 404) (Request-ID: req-f4a995bb-7248-4fdb-a76e-37e92ec48193) Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:47.219123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:14:47.220548 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 65ea2064-5521-4de2-9efa-0410b8733a4c could not be found. Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:14:47.221934 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 65ea2064-5521-4de2-9efa-0410b8733a4c could not be found. Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 65ea2064-5521-4de2-9efa-0410b8733a4c could not be found. Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f3153fac-8efc-4a87-b341-f9a3c268d3ea tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] Returning 404 to user: Volume 65ea2064-5521-4de2-9efa-0410b8733a4c could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f3153fac-8efc-4a87-b341-f9a3c268d3ea tempest-VolumesGetTestJSON-28385180 tempest-VolumesGetTestJSON-28385180-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c" status: 404 len: 109 microversion: 2.1 time: 0.036008 Aug 29 19:14:47.223412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 511/1031] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:14:47 2022] GET /compute/v2.1/os-volumes/65ea2064-5521-4de2-9efa-0410b8733a4c => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:14:47.742376 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:47.743470 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:47.751491 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:47.752358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:47.753004 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:47.753909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:47.755034 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:47.756131 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:48.112223 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:48.122250 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:48.124478 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:48.124909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d045ac0f-a3e5-476d-857a-806b27ab7e2a tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.387156 Aug 29 19:14:48.136538 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 521/1032] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:47 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:48.217188 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-96df69d3-772f-4257-93f9-acd434a1914e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:48.218058 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-96df69d3-772f-4257-93f9-acd434a1914e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:48.232573 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96df69d3-772f-4257-93f9-acd434a1914e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:48.233080 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96df69d3-772f-4257-93f9-acd434a1914e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:48.233520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96df69d3-772f-4257-93f9-acd434a1914e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:48.243997 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96df69d3-772f-4257-93f9-acd434a1914e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:48.244509 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96df69d3-772f-4257-93f9-acd434a1914e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:48.244939 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96df69d3-772f-4257-93f9-acd434a1914e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:48.503272 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-96df69d3-772f-4257-93f9-acd434a1914e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:48.510932 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-96df69d3-772f-4257-93f9-acd434a1914e tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1313 microversion: 2.1 time: 0.297737 Aug 29 19:14:48.511732 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 512/1033] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:48 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:48.879605 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-66ae5264-5198-4d95-b4c2-4c6703744ab4 req-874c0fc0-0ec8-47fe-8703-693a2fb2dc70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1432924-6374-40ee-9a9e-ea2156bcc481", "tag": "9ebd42f0-be62-4e4a-860c-ba19f43a5450"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:48.901219 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-66ae5264-5198-4d95-b4c2-4c6703744ab4 req-874c0fc0-0ec8-47fe-8703-693a2fb2dc70 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:48.901219 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-66ae5264-5198-4d95-b4c2-4c6703744ab4 req-874c0fc0-0ec8-47fe-8703-693a2fb2dc70 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:48.913368 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-66ae5264-5198-4d95-b4c2-4c6703744ab4 req-874c0fc0-0ec8-47fe-8703-693a2fb2dc70 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:48.932082 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-66ae5264-5198-4d95-b4c2-4c6703744ab4 req-874c0fc0-0ec8-47fe-8703-693a2fb2dc70 service nova] Creating event network-changed:9ebd42f0-be62-4e4a-860c-ba19f43a5450 for instance a1432924-6374-40ee-9a9e-ea2156bcc481 on hv-cinder-73126 Aug 29 19:14:48.938371 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-66ae5264-5198-4d95-b4c2-4c6703744ab4 req-874c0fc0-0ec8-47fe-8703-693a2fb2dc70 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062732 Aug 29 19:14:48.941108 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 522/1034] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:49.149168 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:49.149909 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:49.157606 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:49.158427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:49.159234 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:49.160264 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b649daf6-1bbf-4595-8984-72b3be46845c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:49.160834 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:49.160957 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b649daf6-1bbf-4595-8984-72b3be46845c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:49.161986 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:49.162813 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:49.167980 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b649daf6-1bbf-4595-8984-72b3be46845c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:49.168334 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b649daf6-1bbf-4595-8984-72b3be46845c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:49.169104 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b649daf6-1bbf-4595-8984-72b3be46845c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:49.169890 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b649daf6-1bbf-4595-8984-72b3be46845c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:49.170431 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b649daf6-1bbf-4595-8984-72b3be46845c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:49.170934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b649daf6-1bbf-4595-8984-72b3be46845c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:49.270481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-b649daf6-1bbf-4595-8984-72b3be46845c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lazy-loading 'services' on Instance uuid 4e51834d-08d0-4905-9dfd-8ea77d2859e9 {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:14:49.359360 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b649daf6-1bbf-4595-8984-72b3be46845c tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments/eefa548a-61c9-49ae-88ef-693b271353db" status: 202 len: 0 microversion: 2.1 time: 0.203154 Aug 29 19:14:49.360522 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 523/1035] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:14:49 2022] DELETE /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments/eefa548a-61c9-49ae-88ef-693b271353db => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 19:14:49.373187 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-304d8681-f0fa-4c49-9e33-f162a49b6ece tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:49.379218 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-304d8681-f0fa-4c49-9e33-f162a49b6ece tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:49.389551 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-304d8681-f0fa-4c49-9e33-f162a49b6ece tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:49.390045 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-304d8681-f0fa-4c49-9e33-f162a49b6ece tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:49.390486 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-304d8681-f0fa-4c49-9e33-f162a49b6ece tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:49.391442 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-304d8681-f0fa-4c49-9e33-f162a49b6ece tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:49.392077 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-304d8681-f0fa-4c49-9e33-f162a49b6ece tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:49.392641 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-304d8681-f0fa-4c49-9e33-f162a49b6ece tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:49.415055 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:49.426374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:49.429042 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:49.430739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-10d8a4da-ab8f-4e79-b57e-3341475d4de8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.285458 Aug 29 19:14:49.430896 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-304d8681-f0fa-4c49-9e33-f162a49b6ece tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064176 Aug 29 19:14:49.431405 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 513/1036] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:49 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:49.444706 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 524/1037] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:14:49 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:14:49.532945 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-241de793-c39b-48b5-b3d9-6965763e0695 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:49.533956 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-241de793-c39b-48b5-b3d9-6965763e0695 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:49.540893 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-241de793-c39b-48b5-b3d9-6965763e0695 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:49.541387 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-241de793-c39b-48b5-b3d9-6965763e0695 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:49.541818 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-241de793-c39b-48b5-b3d9-6965763e0695 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:49.542536 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-241de793-c39b-48b5-b3d9-6965763e0695 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:49.542994 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-241de793-c39b-48b5-b3d9-6965763e0695 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:49.543441 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-241de793-c39b-48b5-b3d9-6965763e0695 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:49.677551 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-241de793-c39b-48b5-b3d9-6965763e0695 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:49.685715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-241de793-c39b-48b5-b3d9-6965763e0695 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1313 microversion: 2.1 time: 0.158225 Aug 29 19:14:49.699247 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 514/1038] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:49 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:50.443928 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8ac25e02-2d09-482a-9467-e9d278fcfed6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:50.446202 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8ac25e02-2d09-482a-9467-e9d278fcfed6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:50.452856 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ac25e02-2d09-482a-9467-e9d278fcfed6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:50.453391 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ac25e02-2d09-482a-9467-e9d278fcfed6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:50.453793 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ac25e02-2d09-482a-9467-e9d278fcfed6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:50.454489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ac25e02-2d09-482a-9467-e9d278fcfed6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:50.454951 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ac25e02-2d09-482a-9467-e9d278fcfed6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:50.455584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8ac25e02-2d09-482a-9467-e9d278fcfed6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:50.456248 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:50.456874 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:50.463805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:50.464335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:50.465307 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:50.466143 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:50.466603 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:50.467260 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:50.472540 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:50.489964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8ac25e02-2d09-482a-9467-e9d278fcfed6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050736 Aug 29 19:14:50.490544 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 525/1039] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:14:50 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:50.605434 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:50.614467 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:50.615948 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:50.617127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6318fcdb-6844-45ae-ba9f-37547a526bc9 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.165121 Aug 29 19:14:50.617680 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 515/1040] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:50 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:50.709791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-31badf79-8854-43bd-9f65-762f0dcde1f9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:50.710325 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-31badf79-8854-43bd-9f65-762f0dcde1f9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:50.716747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31badf79-8854-43bd-9f65-762f0dcde1f9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:50.717305 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31badf79-8854-43bd-9f65-762f0dcde1f9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:50.717754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31badf79-8854-43bd-9f65-762f0dcde1f9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:50.718641 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31badf79-8854-43bd-9f65-762f0dcde1f9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:50.719146 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31badf79-8854-43bd-9f65-762f0dcde1f9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:50.719577 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-31badf79-8854-43bd-9f65-762f0dcde1f9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:50.851103 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-31badf79-8854-43bd-9f65-762f0dcde1f9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:50.859192 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-31badf79-8854-43bd-9f65-762f0dcde1f9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1313 microversion: 2.1 time: 0.153525 Aug 29 19:14:50.859770 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 526/1041] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:50 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:51.504109 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c00d65d3-8a5a-41ea-b999-1f8dcc7a8808 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:51.506967 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c00d65d3-8a5a-41ea-b999-1f8dcc7a8808 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:51.514839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c00d65d3-8a5a-41ea-b999-1f8dcc7a8808 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:51.515621 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c00d65d3-8a5a-41ea-b999-1f8dcc7a8808 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:51.516279 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c00d65d3-8a5a-41ea-b999-1f8dcc7a8808 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:51.518693 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c00d65d3-8a5a-41ea-b999-1f8dcc7a8808 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:51.519552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c00d65d3-8a5a-41ea-b999-1f8dcc7a8808 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:51.520200 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c00d65d3-8a5a-41ea-b999-1f8dcc7a8808 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:51.579929 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c00d65d3-8a5a-41ea-b999-1f8dcc7a8808 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081825 Aug 29 19:14:51.581207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 516/1042] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:14:51 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:51.640316 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:51.640925 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:51.649423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:51.649979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:51.650764 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:51.651699 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:51.652366 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:51.652963 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:51.880055 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e10ef57c-45ef-4ce2-bb14-5dd41180050f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:51.880679 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e10ef57c-45ef-4ce2-bb14-5dd41180050f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:51.887241 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e10ef57c-45ef-4ce2-bb14-5dd41180050f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:51.887725 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e10ef57c-45ef-4ce2-bb14-5dd41180050f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:51.888157 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e10ef57c-45ef-4ce2-bb14-5dd41180050f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:51.888861 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e10ef57c-45ef-4ce2-bb14-5dd41180050f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:51.889315 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e10ef57c-45ef-4ce2-bb14-5dd41180050f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:51.889739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e10ef57c-45ef-4ce2-bb14-5dd41180050f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:52.194131 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:52.203547 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:52.205721 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:52.206904 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6e2d3a1d-4155-4984-9bee-bcb55458a508 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.570771 Aug 29 19:14:52.207498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 527/1043] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:51 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:52.208994 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-e10ef57c-45ef-4ce2-bb14-5dd41180050f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:52.216879 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e10ef57c-45ef-4ce2-bb14-5dd41180050f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1313 microversion: 2.1 time: 0.341009 Aug 29 19:14:52.217411 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 517/1044] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:51 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:52.429424 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-d2074fb8-8091-44b7-b316-150b289656ff req-cf747973-f200-4ac9-bff6-e3c5a582759c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9713d174-1918-4168-b6e7-bf1359b50155", "name": "network-vif-plugged", "status": "completed", "tag": "d4371ad0-840e-40ed-b29d-5fdc435f7837"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:52.440110 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-d2074fb8-8091-44b7-b316-150b289656ff req-cf747973-f200-4ac9-bff6-e3c5a582759c service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:52.440756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-d2074fb8-8091-44b7-b316-150b289656ff req-cf747973-f200-4ac9-bff6-e3c5a582759c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:52.441199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-d2074fb8-8091-44b7-b316-150b289656ff req-cf747973-f200-4ac9-bff6-e3c5a582759c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:52.452563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-d2074fb8-8091-44b7-b316-150b289656ff req-cf747973-f200-4ac9-bff6-e3c5a582759c service nova] Creating event network-vif-plugged:d4371ad0-840e-40ed-b29d-5fdc435f7837 for instance 9713d174-1918-4168-b6e7-bf1359b50155 on hv-cinder-73126 Aug 29 19:14:52.457645 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-d2074fb8-8091-44b7-b316-150b289656ff req-cf747973-f200-4ac9-bff6-e3c5a582759c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031883 Aug 29 19:14:52.458279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 528/1045] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:52.593507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d75db9f2-37d9-4c72-b86c-7275f964f8d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:52.596830 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d75db9f2-37d9-4c72-b86c-7275f964f8d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:52.603427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d75db9f2-37d9-4c72-b86c-7275f964f8d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:52.603919 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d75db9f2-37d9-4c72-b86c-7275f964f8d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:52.604358 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d75db9f2-37d9-4c72-b86c-7275f964f8d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:52.605110 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d75db9f2-37d9-4c72-b86c-7275f964f8d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:52.605564 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d75db9f2-37d9-4c72-b86c-7275f964f8d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:52.605984 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d75db9f2-37d9-4c72-b86c-7275f964f8d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:52.638770 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d75db9f2-37d9-4c72-b86c-7275f964f8d6 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049638 Aug 29 19:14:52.639355 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 518/1046] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:14:52 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:14:52.705783 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-81097c04-b245-4c5c-be22-56ede3bf2f15 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:52.706485 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-81097c04-b245-4c5c-be22-56ede3bf2f15 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:52.712994 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81097c04-b245-4c5c-be22-56ede3bf2f15 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:52.713476 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81097c04-b245-4c5c-be22-56ede3bf2f15 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:52.713909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81097c04-b245-4c5c-be22-56ede3bf2f15 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:52.714602 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81097c04-b245-4c5c-be22-56ede3bf2f15 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:52.715266 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81097c04-b245-4c5c-be22-56ede3bf2f15 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:52.715692 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-81097c04-b245-4c5c-be22-56ede3bf2f15 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:52.742969 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-81097c04-b245-4c5c-be22-56ede3bf2f15 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:14:52.834739 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-81097c04-b245-4c5c-be22-56ede3bf2f15 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 204 len: 0 microversion: 2.1 time: 0.133349 Aug 29 19:14:52.835712 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 529/1047] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:14:52 2022] DELETE /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:14:52.844825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6451cd4f-c8c9-49e8-9d6e-9bce2cf939be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:52.845466 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6451cd4f-c8c9-49e8-9d6e-9bce2cf939be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:52.851483 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6451cd4f-c8c9-49e8-9d6e-9bce2cf939be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:52.851975 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6451cd4f-c8c9-49e8-9d6e-9bce2cf939be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:52.852413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6451cd4f-c8c9-49e8-9d6e-9bce2cf939be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:52.853107 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6451cd4f-c8c9-49e8-9d6e-9bce2cf939be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:52.853567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6451cd4f-c8c9-49e8-9d6e-9bce2cf939be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:52.853994 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6451cd4f-c8c9-49e8-9d6e-9bce2cf939be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:52.994694 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6451cd4f-c8c9-49e8-9d6e-9bce2cf939be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:53.003596 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6451cd4f-c8c9-49e8-9d6e-9bce2cf939be tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1681 microversion: 2.1 time: 0.163620 Aug 29 19:14:53.004292 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 519/1048] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:52 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:53.230470 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:53.231199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:53.237839 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:53.238040 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-b4c4ffd6-6237-42fc-bdb8-adebdfbe7257 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:53.238356 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:53.238588 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-b4c4ffd6-6237-42fc-bdb8-adebdfbe7257 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:53.238853 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:53.239600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:53.240061 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:53.240486 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:53.246462 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4c4ffd6-6237-42fc-bdb8-adebdfbe7257 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:53.247906 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4c4ffd6-6237-42fc-bdb8-adebdfbe7257 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:53.248363 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4c4ffd6-6237-42fc-bdb8-adebdfbe7257 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:53.249992 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4c4ffd6-6237-42fc-bdb8-adebdfbe7257 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:53.250969 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4c4ffd6-6237-42fc-bdb8-adebdfbe7257 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:53.251629 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-b4c4ffd6-6237-42fc-bdb8-adebdfbe7257 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:53.446218 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:53.449426 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-b4c4ffd6-6237-42fc-bdb8-adebdfbe7257 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:53.456498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:53.457374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-b4c4ffd6-6237-42fc-bdb8-adebdfbe7257 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1313 microversion: 2.1 time: 0.223677 Aug 29 19:14:53.457967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:53.459885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6f2056a3-037f-4453-99a4-0010144c32fd tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.233883 Aug 29 19:14:53.460571 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 530/1049] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:53 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:53.471196 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 520/1050] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:53 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:54.027571 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5dff3583-772f-4ba9-8080-82808b183e86 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:54.028213 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5dff3583-772f-4ba9-8080-82808b183e86 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:54.035602 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5dff3583-772f-4ba9-8080-82808b183e86 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:54.036149 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5dff3583-772f-4ba9-8080-82808b183e86 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:54.036634 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5dff3583-772f-4ba9-8080-82808b183e86 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:54.037354 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5dff3583-772f-4ba9-8080-82808b183e86 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:54.037807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5dff3583-772f-4ba9-8080-82808b183e86 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:54.038230 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5dff3583-772f-4ba9-8080-82808b183e86 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:54.167322 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5dff3583-772f-4ba9-8080-82808b183e86 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:54.175977 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5dff3583-772f-4ba9-8080-82808b183e86 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1681 microversion: 2.1 time: 0.152250 Aug 29 19:14:54.176542 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 531/1051] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:54 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:54.478161 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0a155f44-1268-4059-a3e6-bcd1b6f73ebf tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:54.478774 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0a155f44-1268-4059-a3e6-bcd1b6f73ebf tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:54.485588 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a155f44-1268-4059-a3e6-bcd1b6f73ebf tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:54.486074 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a155f44-1268-4059-a3e6-bcd1b6f73ebf tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:54.487210 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a155f44-1268-4059-a3e6-bcd1b6f73ebf tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:54.487958 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a155f44-1268-4059-a3e6-bcd1b6f73ebf tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:54.488505 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a155f44-1268-4059-a3e6-bcd1b6f73ebf tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:54.488930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0a155f44-1268-4059-a3e6-bcd1b6f73ebf tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:54.494036 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:54.494778 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:54.501510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:54.502298 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:54.502964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:54.503726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:54.504698 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:54.505698 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:54.691923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0a155f44-1268-4059-a3e6-bcd1b6f73ebf tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:54.699774 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0a155f44-1268-4059-a3e6-bcd1b6f73ebf tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1313 microversion: 2.1 time: 0.225677 Aug 29 19:14:54.713965 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:54.714584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:54.715055 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 521/1052] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:54 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:54.715833 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:54.717013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-541afea5-cbe3-416e-921e-0e3b2710c6da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.227044 Aug 29 19:14:54.717724 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 532/1053] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:54 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:55.196864 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-aa5baf38-4930-4c8a-8df2-b17f1a85761d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:55.197564 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-aa5baf38-4930-4c8a-8df2-b17f1a85761d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:55.203601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aa5baf38-4930-4c8a-8df2-b17f1a85761d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:55.204159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aa5baf38-4930-4c8a-8df2-b17f1a85761d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:55.204604 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aa5baf38-4930-4c8a-8df2-b17f1a85761d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:55.205374 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aa5baf38-4930-4c8a-8df2-b17f1a85761d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:55.205948 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aa5baf38-4930-4c8a-8df2-b17f1a85761d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:55.206378 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-aa5baf38-4930-4c8a-8df2-b17f1a85761d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:55.361448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-aa5baf38-4930-4c8a-8df2-b17f1a85761d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:55.370079 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-aa5baf38-4930-4c8a-8df2-b17f1a85761d tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1681 microversion: 2.1 time: 0.177055 Aug 29 19:14:55.370756 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 522/1054] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:55 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:55.721656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-34fe6aec-6596-4720-a35e-17e4b8481211 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:55.722280 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-34fe6aec-6596-4720-a35e-17e4b8481211 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:55.728623 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-34fe6aec-6596-4720-a35e-17e4b8481211 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:55.729106 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-34fe6aec-6596-4720-a35e-17e4b8481211 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:55.729541 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-34fe6aec-6596-4720-a35e-17e4b8481211 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:55.730232 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-34fe6aec-6596-4720-a35e-17e4b8481211 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:55.730690 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-34fe6aec-6596-4720-a35e-17e4b8481211 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:55.731142 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-34fe6aec-6596-4720-a35e-17e4b8481211 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:55.735629 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:55.742435 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:55.743052 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:55.749964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:55.750555 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:55.751313 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:55.752278 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:55.752818 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:55.753408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:56.002031 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-34fe6aec-6596-4720-a35e-17e4b8481211 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:56.005568 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:56.010764 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-34fe6aec-6596-4720-a35e-17e4b8481211 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1313 microversion: 2.1 time: 0.293591 Aug 29 19:14:56.011519 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 533/1055] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:55 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:56.027645 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:56.029228 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:56.030486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d8592430-0857-45d5-9a94-900b06edcbcb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.291972 Aug 29 19:14:56.031136 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 523/1056] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:55 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:56.393148 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a8ed3c1c-273f-46ea-bbad-731a782c72a2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:56.393973 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a8ed3c1c-273f-46ea-bbad-731a782c72a2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:56.407576 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8ed3c1c-273f-46ea-bbad-731a782c72a2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:56.412918 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8ed3c1c-273f-46ea-bbad-731a782c72a2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:56.413601 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8ed3c1c-273f-46ea-bbad-731a782c72a2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:56.414866 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8ed3c1c-273f-46ea-bbad-731a782c72a2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:56.416148 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8ed3c1c-273f-46ea-bbad-731a782c72a2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:56.417163 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a8ed3c1c-273f-46ea-bbad-731a782c72a2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:56.616572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-0af76498-2613-432b-9326-f6f9f44ae28e req-c0e85e63-8386-4d5a-906a-29249871187d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1432924-6374-40ee-9a9e-ea2156bcc481", "name": "network-vif-plugged", "status": "completed", "tag": "9ebd42f0-be62-4e4a-860c-ba19f43a5450"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:56.637085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-0af76498-2613-432b-9326-f6f9f44ae28e req-c0e85e63-8386-4d5a-906a-29249871187d service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:56.641141 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-0af76498-2613-432b-9326-f6f9f44ae28e req-c0e85e63-8386-4d5a-906a-29249871187d service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:56.642090 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-0af76498-2613-432b-9326-f6f9f44ae28e req-c0e85e63-8386-4d5a-906a-29249871187d service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:56.671459 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-0af76498-2613-432b-9326-f6f9f44ae28e req-c0e85e63-8386-4d5a-906a-29249871187d service nova] Creating event network-vif-plugged:9ebd42f0-be62-4e4a-860c-ba19f43a5450 for instance a1432924-6374-40ee-9a9e-ea2156bcc481 on hv-cinder-73126 Aug 29 19:14:56.680523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-0af76498-2613-432b-9326-f6f9f44ae28e req-c0e85e63-8386-4d5a-906a-29249871187d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067722 Aug 29 19:14:56.682326 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 524/1057] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:56.684110 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-a8ed3c1c-273f-46ea-bbad-731a782c72a2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:56.698504 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a8ed3c1c-273f-46ea-bbad-731a782c72a2 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1681 microversion: 2.1 time: 0.308743 Aug 29 19:14:56.700263 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 534/1058] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:56 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1681 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:57.033057 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5df6b335-3aa4-4269-af1c-860c70b48fe7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:57.034009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5df6b335-3aa4-4269-af1c-860c70b48fe7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:57.040345 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5df6b335-3aa4-4269-af1c-860c70b48fe7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:57.040753 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5df6b335-3aa4-4269-af1c-860c70b48fe7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:57.041187 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5df6b335-3aa4-4269-af1c-860c70b48fe7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:57.041884 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5df6b335-3aa4-4269-af1c-860c70b48fe7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:57.042564 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5df6b335-3aa4-4269-af1c-860c70b48fe7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:57.043051 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5df6b335-3aa4-4269-af1c-860c70b48fe7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:57.055308 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:57.056614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:57.064402 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:57.065753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:57.066481 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:57.067830 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:57.068754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:57.071335 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:57.411457 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5df6b335-3aa4-4269-af1c-860c70b48fe7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:57.428298 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5df6b335-3aa4-4269-af1c-860c70b48fe7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1313 microversion: 2.1 time: 0.395712 Aug 29 19:14:57.430368 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 525/1059] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:57 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:57.444919 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:57.463454 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:57.464861 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:57.466303 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-18ac9812-5556-45ec-a473-a30f166fff90 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1732 microversion: 2.20 time: 0.414857 Aug 29 19:14:57.467102 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 535/1060] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:57 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1732 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 19:14:57.477411 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-53982978-4e6d-4247-9090-55ff8947db75 req-ec3a3e01-e952-435a-853a-12b34477fbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e51834d-08d0-4905-9dfd-8ea77d2859e9", "name": "network-vif-deleted", "tag": "30c4fffe-282d-4ca5-999f-190eabe30cfc"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:14:57.491784 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-53982978-4e6d-4247-9090-55ff8947db75 req-ec3a3e01-e952-435a-853a-12b34477fbfd service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:57.493449 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-53982978-4e6d-4247-9090-55ff8947db75 req-ec3a3e01-e952-435a-853a-12b34477fbfd service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:57.494144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-53982978-4e6d-4247-9090-55ff8947db75 req-ec3a3e01-e952-435a-853a-12b34477fbfd service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:57.509692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-53982978-4e6d-4247-9090-55ff8947db75 req-ec3a3e01-e952-435a-853a-12b34477fbfd service nova] Creating event network-vif-deleted:30c4fffe-282d-4ca5-999f-190eabe30cfc for instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 on hv-cinder-73126 Aug 29 19:14:57.514676 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-53982978-4e6d-4247-9090-55ff8947db75 req-ec3a3e01-e952-435a-853a-12b34477fbfd service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041368 Aug 29 19:14:57.515304 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 526/1061] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:14:57.721189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:57.722410 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:57.730635 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:57.731707 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:57.732495 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:57.733756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:57.734765 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:57.735538 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:57.776620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:57.777119 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:57.777557 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:57.778013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lazy-loading 'fault' on Instance uuid 4e51834d-08d0-4905-9dfd-8ea77d2859e9 {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:14:57.825583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:57.834621 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f5499ad9-f8f3-43de-8b32-b750ca7e5aba tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1330 microversion: 2.1 time: 0.117445 Aug 29 19:14:57.835832 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 536/1062] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:57 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1330 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:14:58.451409 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fab705ef-e45f-4333-804c-4e430a0d67a0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:58.452264 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fab705ef-e45f-4333-804c-4e430a0d67a0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:58.458848 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fab705ef-e45f-4333-804c-4e430a0d67a0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:58.459369 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fab705ef-e45f-4333-804c-4e430a0d67a0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:58.459799 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fab705ef-e45f-4333-804c-4e430a0d67a0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:58.460499 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fab705ef-e45f-4333-804c-4e430a0d67a0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:58.460949 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fab705ef-e45f-4333-804c-4e430a0d67a0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:58.461365 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fab705ef-e45f-4333-804c-4e430a0d67a0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:58.494000 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:58.495467 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:58.517008 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:58.517682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:58.518363 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:58.520054 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:58.521497 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:58.522363 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:58.664903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fab705ef-e45f-4333-804c-4e430a0d67a0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:58.679820 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fab705ef-e45f-4333-804c-4e430a0d67a0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1497 microversion: 2.1 time: 0.233687 Aug 29 19:14:58.680704 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 527/1063] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:58 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1497 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:58.720049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:58.729221 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:58.730677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:58.731871 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2139186c-5da2-43a0-a76d-655b375d594b tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1719 microversion: 2.20 time: 0.242140 Aug 29 19:14:58.732445 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 537/1064] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:14:58 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1719 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:14:58.856940 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:58.857555 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:58.867344 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:58.867747 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:58.868181 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:58.868884 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:58.869508 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:58.869933 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:58.916861 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:58.917363 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:58.917857 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:58.918392 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lazy-loading 'fault' on Instance uuid 4e51834d-08d0-4905-9dfd-8ea77d2859e9 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:14:58.977577 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0bc9e010d044a5a2147010cbdb4d85', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b967c22662da47aeb9292704c39b44bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:58.989758 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0cd6a2a9-02d9-4fd8-9579-d311c9a35eae tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 200 len: 1330 microversion: 2.1 time: 0.136634 Aug 29 19:14:58.990902 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 528/1065] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:58 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 1330 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:14:59.268327 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6fc0f2c7-c65a-4674-a306-82559e2ec2ae tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:59.269118 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6fc0f2c7-c65a-4674-a306-82559e2ec2ae tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:59.275921 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fc0f2c7-c65a-4674-a306-82559e2ec2ae tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:59.276365 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fc0f2c7-c65a-4674-a306-82559e2ec2ae tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:59.276811 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fc0f2c7-c65a-4674-a306-82559e2ec2ae tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:59.277593 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fc0f2c7-c65a-4674-a306-82559e2ec2ae tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:59.278150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fc0f2c7-c65a-4674-a306-82559e2ec2ae tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:59.278389 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6fc0f2c7-c65a-4674-a306-82559e2ec2ae tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:59.306736 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6fc0f2c7-c65a-4674-a306-82559e2ec2ae tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:14:59.383416 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:14:59.403892 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6fc0f2c7-c65a-4674-a306-82559e2ec2ae tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "DELETE /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 204 len: 0 microversion: 2.1 time: 0.139963 Aug 29 19:14:59.407823 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 538/1066] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:14:59 2022] DELETE /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:14:59.415380 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9a4a1a3c-4c7e-41f6-b9b2-0575438315e4 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:14:59.416035 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9a4a1a3c-4c7e-41f6-b9b2-0575438315e4 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:14:59.423060 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9a4a1a3c-4c7e-41f6-b9b2-0575438315e4 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:59.424196 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9a4a1a3c-4c7e-41f6-b9b2-0575438315e4 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:59.424788 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9a4a1a3c-4c7e-41f6-b9b2-0575438315e4 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:59.425515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9a4a1a3c-4c7e-41f6-b9b2-0575438315e4 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:14:59.426006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9a4a1a3c-4c7e-41f6-b9b2-0575438315e4 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:14:59.426611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9a4a1a3c-4c7e-41f6-b9b2-0575438315e4 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:14:59.563543 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9a4a1a3c-4c7e-41f6-b9b2-0575438315e4 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:14:59.571685 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9a4a1a3c-4c7e-41f6-b9b2-0575438315e4 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1503 microversion: 2.1 time: 0.161254 Aug 29 19:14:59.572355 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 529/1067] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:14:59 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:00.013685 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:00.014616 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:00.021909 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:00.022403 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:00.022837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:00.023735 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:00.024255 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:00.024796 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:00.040335 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 HTTP/1.1 Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:15:00.041985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:00.043409 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '4e51834d-08d0-4905-9dfd-8ea77d2859e9'} Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:00.044189 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:00.045878 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:00.047016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:00.047016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-be0e1fe7-7a0b-4b43-a512-8355a85065c1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 404 len: 111 microversion: 2.1 time: 0.034407 Aug 29 19:15:00.047016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 539/1068] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:00 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:15:00.055537 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a876e3a5-ac6a-4615-8aa1-a3c8ddcf7af0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '.version_select at 0x7f3d767c1940>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:00.078123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a876e3a5-ac6a-4615-8aa1-a3c8ddcf7af0 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-547695508" status: 202 len: 0 microversion: 2.1 time: 0.028631 Aug 29 19:15:00.078727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 530/1069] 10.222.0.94 () {58 vars in 1218 bytes} [Mon Aug 29 19:15:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-547695508 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:15:00.593437 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f76bdf6e-0311-421e-a278-9aeaf59c3496 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:00.594369 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f76bdf6e-0311-421e-a278-9aeaf59c3496 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:00.601358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f76bdf6e-0311-421e-a278-9aeaf59c3496 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:00.601851 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f76bdf6e-0311-421e-a278-9aeaf59c3496 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:00.602443 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f76bdf6e-0311-421e-a278-9aeaf59c3496 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:00.603185 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f76bdf6e-0311-421e-a278-9aeaf59c3496 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:00.603807 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f76bdf6e-0311-421e-a278-9aeaf59c3496 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:00.604746 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f76bdf6e-0311-421e-a278-9aeaf59c3496 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:00.817733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f76bdf6e-0311-421e-a278-9aeaf59c3496 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:00.825616 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f76bdf6e-0311-421e-a278-9aeaf59c3496 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1503 microversion: 2.1 time: 0.236765 Aug 29 19:15:00.826414 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 540/1070] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:00 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:01.775750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-151825da-f78a-4c9d-a6ce-aee5299eda2a req-7690e9e0-c40d-470c-b016-673a485e9f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1432924-6374-40ee-9a9e-ea2156bcc481", "name": "network-vif-deleted", "tag": "9ebd42f0-be62-4e4a-860c-ba19f43a5450"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:01.788974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-151825da-f78a-4c9d-a6ce-aee5299eda2a req-7690e9e0-c40d-470c-b016-673a485e9f2d service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:01.789581 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-151825da-f78a-4c9d-a6ce-aee5299eda2a req-7690e9e0-c40d-470c-b016-673a485e9f2d service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:01.789971 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-151825da-f78a-4c9d-a6ce-aee5299eda2a req-7690e9e0-c40d-470c-b016-673a485e9f2d service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:01.804985 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-151825da-f78a-4c9d-a6ce-aee5299eda2a req-7690e9e0-c40d-470c-b016-673a485e9f2d service nova] Creating event network-vif-deleted:9ebd42f0-be62-4e4a-860c-ba19f43a5450 for instance a1432924-6374-40ee-9a9e-ea2156bcc481 on hv-cinder-73126 Aug 29 19:15:01.811524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-151825da-f78a-4c9d-a6ce-aee5299eda2a req-7690e9e0-c40d-470c-b016-673a485e9f2d service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041161 Aug 29 19:15:01.812134 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 531/1071] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:01.849052 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f49a82da-c338-491d-acfe-d586ebaf7e40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:01.851579 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f49a82da-c338-491d-acfe-d586ebaf7e40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:01.864715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f49a82da-c338-491d-acfe-d586ebaf7e40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:01.865503 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f49a82da-c338-491d-acfe-d586ebaf7e40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:01.865946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f49a82da-c338-491d-acfe-d586ebaf7e40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:01.866667 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f49a82da-c338-491d-acfe-d586ebaf7e40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:01.867165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f49a82da-c338-491d-acfe-d586ebaf7e40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:01.867785 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f49a82da-c338-491d-acfe-d586ebaf7e40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:01.944452 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f49a82da-c338-491d-acfe-d586ebaf7e40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:01.952879 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f49a82da-c338-491d-acfe-d586ebaf7e40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 200 len: 1298 microversion: 2.1 time: 0.108882 Aug 29 19:15:01.956651 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:01.958628 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:01.966524 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 541/1072] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:01 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:01.969371 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:01.969892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:01.970514 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:01.971919 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:01.972555 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:01.973003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:01.989276 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: DELETE /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 HTTP/1.1 Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:01.991043 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:01.992500 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '4e51834d-08d0-4905-9dfd-8ea77d2859e9'} Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:01.993261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:01.994528 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:01.995906 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:01.995906 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e0d96a35-d66f-4138-b9a3-9b381a095100 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 404 len: 111 microversion: 2.1 time: 0.041603 Aug 29 19:15:01.995906 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 532/1073] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:15:01 2022] DELETE /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:15:02.001567 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:02.002331 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 4e51834d-08d0-4905-9dfd-8ea77d2859e9] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:02.010494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:02.011678 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:02.012187 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:02.013356 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:02.013825 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:02.014276 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:02.030345 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 HTTP/1.1 Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:15:02.032132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:02.034222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '4e51834d-08d0-4905-9dfd-8ea77d2859e9'} Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:02.035025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. Aug 29 19:15:02.036265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:02.037336 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 4e51834d-08d0-4905-9dfd-8ea77d2859e9 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:02.037336 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-360472e5-84e0-4db6-a7bc-6fe63488cf09 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9" status: 404 len: 111 microversion: 2.1 time: 0.036696 Aug 29 19:15:02.037336 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 542/1074] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:01 2022] GET /compute/v2.1/servers/4e51834d-08d0-4905-9dfd-8ea77d2859e9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:15:02.973825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:02.974442 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: a1432924-6374-40ee-9a9e-ea2156bcc481] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:02.977073 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:02.982727 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:02.983352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:02.983795 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:02.984490 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:02.984946 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:02.985390 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.001074 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] HTTP exception thrown: Instance a1432924-6374-40ee-9a9e-ea2156bcc481 could not be found. Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Request method failure captured: Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 HTTP/1.1 Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDRAXMeIhBQMzA33PKqleBKB44FdLzxKE2alGchrIP20msN7tGTpLOitTzXK34PBoMduH44HKbyonRyk5rVM46nYTZfl3cDWNbWel5GzG9Z4BD_KuEs-BNMk1T16cC17WdPHeJGB1fHWJziJZzrVDABj8vWKIw26NxOILG9l7fmz0_i8 Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: abcda882db7046eab245492bc4c4d7e6 Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-VolumesActionsTest-1621171274 Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:03.002652 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/abcda882db7046eab245492bc4c4d7e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_abcda882db7046eab245492bc4c4d7e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/abcda882db7046eab245492bc4c4d7e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/abcda882db7046eab245492bc4c4d7e6"}]}] Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-VolumesActionsTest-1621171274 Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: abcda882db7046eab245492bc4c4d7e6 Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-VolumesActionsTest-1621171274 Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-VolumesActionsTest-1621171274-project Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: bccc502170e349e0848922712c574ca7 Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-VolumesActionsTest-1621171274-project Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance a1432924-6374-40ee-9a9e-ea2156bcc481 could not be found. Aug 29 19:15:03.004069 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': 'a1432924-6374-40ee-9a9e-ea2156bcc481'} Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1432924-6374-40ee-9a9e-ea2156bcc481 could not be found. Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:03.004825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1432924-6374-40ee-9a9e-ea2156bcc481 could not be found. Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1432924-6374-40ee-9a9e-ea2156bcc481 could not be found. Aug 29 19:15:03.006282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.007495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Returning 404 to user: Instance a1432924-6374-40ee-9a9e-ea2156bcc481 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:03.007495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-133713d2-d98b-4eba-8e41-4e46a3c7f44d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481" status: 404 len: 111 microversion: 2.1 time: 0.035002 Aug 29 19:15:03.007495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 533/1075] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:02 2022] GET /compute/v2.1/servers/a1432924-6374-40ee-9a9e-ea2156bcc481 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:15:03.114404 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-586797778", "imageRef": "3ce41083-8952-4fae-826c-3044fc67e959", "flavorRef": "452", "networks": [{"uuid": "3fdbe9fa-77da-455d-95a7-01c7fcef80b3"}]}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:03.170289 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] validate_networks() for [('3fdbe9fa-77da-455d-95a7-01c7fcef80b3', None, None, None, None, None)] {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:15:03.185551 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:03.186063 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:03.193077 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:03.193572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:03.194092 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.195288 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:03.195783 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:03.196217 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.211224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: DELETE /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 HTTP/1.1 Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:03.212835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:15:03.214159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '0ddcbed3-129a-497b-aefb-a8a42ad2aec6'} Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:03.214991 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:15:03.216263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.217470 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:03.217470 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-538795f4-e15f-4b88-a261-0af6a18a42b5 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 404 len: 111 microversion: 2.1 time: 0.032641 Aug 29 19:15:03.217470 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 534/1076] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:15:03 2022] DELETE /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:15:03.222748 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:03.223384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 0ddcbed3-129a-497b-aefb-a8a42ad2aec6] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:03.229696 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:03.230187 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:03.231828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.231828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:03.231828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:03.232214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.246551 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 HTTP/1.1 Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:03.248251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:15:03.251659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '0ddcbed3-129a-497b-aefb-a8a42ad2aec6'} Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:03.253532 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. Aug 29 19:15:03.254786 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.255907 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 0ddcbed3-129a-497b-aefb-a8a42ad2aec6 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:03.255907 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-26e37489-ce01-43de-bfd1-901aa10f8ae4 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6" status: 404 len: 111 microversion: 2.1 time: 0.031074 Aug 29 19:15:03.255907 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 535/1077] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:03 2022] GET /compute/v2.1/servers/0ddcbed3-129a-497b-aefb-a8a42ad2aec6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:15:03.261902 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:03.262511 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:03.271213 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:03.271833 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:03.272379 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.273251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:03.274050 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:03.274733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.289875 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: DELETE /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 HTTP/1.1 Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:03.291523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:15:03.293301 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '43a8cf0d-0651-4bf9-9fc2-24a66d1528a0'} Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:03.294139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:15:03.295552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.296930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:03.296930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-959d4f20-eb66-44f8-b349-dca8d1b65231 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 404 len: 111 microversion: 2.1 time: 0.035199 Aug 29 19:15:03.296930 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 536/1078] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:15:03 2022] DELETE /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:15:03.306669 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:03.307400 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:03.316789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:03.317385 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:03.317894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.318622 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:03.319096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:03.323642 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.338790 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 HTTP/1.1 Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:03.340280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:15:03.341892 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '43a8cf0d-0651-4bf9-9fc2-24a66d1528a0'} Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:03.343048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. Aug 29 19:15:03.344352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:03.346631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:03.346631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a647cc8f-b5cf-4004-980a-b799c187c2b1 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0" status: 404 len: 111 microversion: 2.1 time: 0.039036 Aug 29 19:15:03.346631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 537/1079] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:03 2022] GET /compute/v2.1/servers/43a8cf0d-0651-4bf9-9fc2-24a66d1528a0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:15:03.567057 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:15:03.567830 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:15:03.568441 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:15:03.568933 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:15:03.569504 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:15:03.578745 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:03.579319 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:03.579762 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.581004 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:03.581487 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:03.581913 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:03.599670 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Getting quotas for project abcda882db7046eab245492bc4c4d7e6. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:15:03.603703 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Getting quotas for user bccc502170e349e0848922712c574ca7 and project abcda882db7046eab245492bc4c4d7e6. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:15:03.615211 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:15:03.617622 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ce41083-8952-4fae-826c-3044fc67e959',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:15:03.670298 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bf6154e8-3515-48d5-89d2-bc114f44dc40 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560215 Aug 29 19:15:03.670946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 543/1080] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:15:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:15:03.683198 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ff8cc9fe-f1e0-4174-9950-cdb037eb7184 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:03.684132 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ff8cc9fe-f1e0-4174-9950-cdb037eb7184 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:03.747235 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ff8cc9fe-f1e0-4174-9950-cdb037eb7184 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:03.755574 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ff8cc9fe-f1e0-4174-9950-cdb037eb7184 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1213 microversion: 2.1 time: 0.076283 Aug 29 19:15:03.756560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 538/1081] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:03 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:04.490644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:04.491206 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:04.497967 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:04.498461 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:04.498907 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:04.499637 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:04.500128 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:04.500560 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:04.514906 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: DELETE /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 HTTP/1.1 Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:15:04.517150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:15:04.519460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '3f54a0ab-56bd-45b7-9026-0c998c315879'} Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:04.520494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:15:04.521837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:04.523113 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:04.523113 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6ca96208-73a8-4e13-871b-4e1d0671390e tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "DELETE /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 404 len: 111 microversion: 2.1 time: 0.032915 Aug 29 19:15:04.523113 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 544/1082] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:15:04 2022] DELETE /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:15:04.527987 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:04.528654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] [instance: 3f54a0ab-56bd-45b7-9026-0c998c315879] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:04.537677 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:04.538163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:04.538689 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:04.539432 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:04.539889 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:04.540313 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:04.553595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] HTTP exception thrown: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Request method failure captured: Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 HTTP/1.1 Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6Jsz5t-bg8ccTyDbRXbySiRCKs8PbiVA4IQd60mcDgCGgxF4sQWtGnP0zTtXjZOnaHLzT6w6XtfIhZZBf6NaQGav4jeqvl1e5wBZUJ7j4MSwv2dv2NcTgZFK4226cXhEnLpboXh6w0bO0oR66HkbiobhLxN5K8_x1uJKcUVUzkTas Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:04.555220 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_b967c22662da47aeb9292704c39b44bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/b967c22662da47aeb9292704c39b44bb"}]}] Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: b967c22662da47aeb9292704c39b44bb Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1963644849 Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ac0bc9e010d044a5a2147010cbdb4d85 Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeNegativeTest-1963644849-project Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:15:04.556808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '3f54a0ab-56bd-45b7-9026-0c998c315879'} Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:04.557804 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. Aug 29 19:15:04.559506 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:04.561152 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] Returning 404 to user: Instance 3f54a0ab-56bd-45b7-9026-0c998c315879 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:04.561152 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8d57a989-fdfb-45f4-904b-29deb325f312 tempest-AttachVolumeNegativeTest-1963644849 tempest-AttachVolumeNegativeTest-1963644849-project] 10.222.0.94 "GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879" status: 404 len: 111 microversion: 2.1 time: 0.032515 Aug 29 19:15:04.561152 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 539/1083] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:04 2022] GET /compute/v2.1/servers/3f54a0ab-56bd-45b7-9026-0c998c315879 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:15:04.777289 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-456acb2a-110f-42de-bbf5-bc335b16d3db tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:04.777813 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-456acb2a-110f-42de-bbf5-bc335b16d3db tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:04.785051 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-456acb2a-110f-42de-bbf5-bc335b16d3db tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:04.785326 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-456acb2a-110f-42de-bbf5-bc335b16d3db tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:04.785676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-456acb2a-110f-42de-bbf5-bc335b16d3db tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:04.786347 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-456acb2a-110f-42de-bbf5-bc335b16d3db tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:04.786805 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-456acb2a-110f-42de-bbf5-bc335b16d3db tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:04.787457 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-456acb2a-110f-42de-bbf5-bc335b16d3db tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:04.890782 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-456acb2a-110f-42de-bbf5-bc335b16d3db tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:04.903355 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-456acb2a-110f-42de-bbf5-bc335b16d3db tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1265 microversion: 2.1 time: 0.129878 Aug 29 19:15:04.905324 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 545/1084] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:04 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1265 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:05.926024 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-440c82d6-23bc-4253-849a-8777905f3b2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:05.927169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-440c82d6-23bc-4253-849a-8777905f3b2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:05.935123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-440c82d6-23bc-4253-849a-8777905f3b2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:05.935730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-440c82d6-23bc-4253-849a-8777905f3b2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:05.936235 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-440c82d6-23bc-4253-849a-8777905f3b2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:05.936977 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-440c82d6-23bc-4253-849a-8777905f3b2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:05.937455 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-440c82d6-23bc-4253-849a-8777905f3b2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:05.937879 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-440c82d6-23bc-4253-849a-8777905f3b2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:05.942223 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=100 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:06.030668 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-440c82d6-23bc-4253-849a-8777905f3b2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:06.039410 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-440c82d6-23bc-4253-849a-8777905f3b2f tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1271 microversion: 2.1 time: 0.117813 Aug 29 19:15:06.046931 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 540/1085] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:05 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:07.062222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1a9cf685-c69e-42c9-94a1-6f1948e63fcd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:07.062998 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1a9cf685-c69e-42c9-94a1-6f1948e63fcd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:07.069731 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1a9cf685-c69e-42c9-94a1-6f1948e63fcd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:07.070482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1a9cf685-c69e-42c9-94a1-6f1948e63fcd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:07.071158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1a9cf685-c69e-42c9-94a1-6f1948e63fcd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:07.071895 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1a9cf685-c69e-42c9-94a1-6f1948e63fcd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:07.072356 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1a9cf685-c69e-42c9-94a1-6f1948e63fcd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:07.072787 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1a9cf685-c69e-42c9-94a1-6f1948e63fcd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:07.338483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1a9cf685-c69e-42c9-94a1-6f1948e63fcd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:07.346838 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1a9cf685-c69e-42c9-94a1-6f1948e63fcd tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1313 microversion: 2.1 time: 0.287982 Aug 29 19:15:07.347467 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 546/1086] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:07 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:07.646066 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-d145926c-170b-4732-b9ec-60442d5acaee req-73945d58-bab6-4ecc-ada0-986ebb909dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5645a960-b066-4519-827b-8e5f6b530af8", "tag": "0fdcef63-1b7e-4793-86c3-12fcf85e7faa"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:07.683457 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-d145926c-170b-4732-b9ec-60442d5acaee req-73945d58-bab6-4ecc-ada0-986ebb909dcb service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:07.683969 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-d145926c-170b-4732-b9ec-60442d5acaee req-73945d58-bab6-4ecc-ada0-986ebb909dcb service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:07.684413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-d145926c-170b-4732-b9ec-60442d5acaee req-73945d58-bab6-4ecc-ada0-986ebb909dcb service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:07.698957 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-d145926c-170b-4732-b9ec-60442d5acaee req-73945d58-bab6-4ecc-ada0-986ebb909dcb service nova] Creating event network-changed:0fdcef63-1b7e-4793-86c3-12fcf85e7faa for instance 5645a960-b066-4519-827b-8e5f6b530af8 on hv-cinder-73126 Aug 29 19:15:07.705169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-d145926c-170b-4732-b9ec-60442d5acaee req-73945d58-bab6-4ecc-ada0-986ebb909dcb service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069535 Aug 29 19:15:07.706293 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 541/1087] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:08.368835 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c8ade31a-ffd4-4e16-a3cc-455a594bcdf7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:08.369434 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c8ade31a-ffd4-4e16-a3cc-455a594bcdf7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:08.376317 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8ade31a-ffd4-4e16-a3cc-455a594bcdf7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:08.376817 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8ade31a-ffd4-4e16-a3cc-455a594bcdf7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:08.378208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8ade31a-ffd4-4e16-a3cc-455a594bcdf7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:08.378920 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8ade31a-ffd4-4e16-a3cc-455a594bcdf7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:08.379411 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8ade31a-ffd4-4e16-a3cc-455a594bcdf7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:08.379842 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c8ade31a-ffd4-4e16-a3cc-455a594bcdf7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:08.549361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c8ade31a-ffd4-4e16-a3cc-455a594bcdf7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:08.557495 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c8ade31a-ffd4-4e16-a3cc-455a594bcdf7 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1313 microversion: 2.1 time: 0.192824 Aug 29 19:15:08.563274 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 547/1088] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:08 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:09.583186 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-136a8105-f639-4f79-9012-22729075f02a tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:09.585633 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-136a8105-f639-4f79-9012-22729075f02a tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:09.598762 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-136a8105-f639-4f79-9012-22729075f02a tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:09.599766 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-136a8105-f639-4f79-9012-22729075f02a tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:09.600464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-136a8105-f639-4f79-9012-22729075f02a tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:09.601566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-136a8105-f639-4f79-9012-22729075f02a tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:09.602249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-136a8105-f639-4f79-9012-22729075f02a tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:09.602962 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-136a8105-f639-4f79-9012-22729075f02a tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:09.936257 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-136a8105-f639-4f79-9012-22729075f02a tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:09.945627 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-136a8105-f639-4f79-9012-22729075f02a tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1313 microversion: 2.1 time: 0.369844 Aug 29 19:15:09.946623 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 542/1089] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:09 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:10.966235 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d968cc6e-e2d2-4b1f-ad78-551923331b11 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:10.966842 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d968cc6e-e2d2-4b1f-ad78-551923331b11 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:10.974405 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d968cc6e-e2d2-4b1f-ad78-551923331b11 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:10.974885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d968cc6e-e2d2-4b1f-ad78-551923331b11 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:10.975337 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d968cc6e-e2d2-4b1f-ad78-551923331b11 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:10.976030 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d968cc6e-e2d2-4b1f-ad78-551923331b11 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:10.976477 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d968cc6e-e2d2-4b1f-ad78-551923331b11 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:10.976893 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d968cc6e-e2d2-4b1f-ad78-551923331b11 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:11.262795 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d968cc6e-e2d2-4b1f-ad78-551923331b11 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:11.271386 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d968cc6e-e2d2-4b1f-ad78-551923331b11 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1313 microversion: 2.1 time: 0.308877 Aug 29 19:15:11.271953 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 548/1090] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:10 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:11.877607 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e4cf1a77-e5d4-4b5a-b32c-c2ac01b03df0 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] Calling method '.version_select at 0x7f3d76629a60>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:11.929341 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e4cf1a77-e5d4-4b5a-b32c-c2ac01b03df0 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/e6573855-e400-4450-b9c3-8cf51503d58e" status: 200 len: 350 microversion: 2.1 time: 0.055657 Aug 29 19:15:11.929925 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 543/1091] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:15:11 2022] GET /compute/v2.1/os-volumes/e6573855-e400-4450-b9c3-8cf51503d58e => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:12.292847 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-cfda146f-1133-4470-ab5d-c6c830fc1b78 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:12.293455 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-cfda146f-1133-4470-ab5d-c6c830fc1b78 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:12.300773 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cfda146f-1133-4470-ab5d-c6c830fc1b78 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:12.301254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cfda146f-1133-4470-ab5d-c6c830fc1b78 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:12.301687 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cfda146f-1133-4470-ab5d-c6c830fc1b78 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:12.302378 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cfda146f-1133-4470-ab5d-c6c830fc1b78 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:12.302830 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cfda146f-1133-4470-ab5d-c6c830fc1b78 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:12.303289 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-cfda146f-1133-4470-ab5d-c6c830fc1b78 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:12.438430 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-cfda146f-1133-4470-ab5d-c6c830fc1b78 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:12.447170 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-cfda146f-1133-4470-ab5d-c6c830fc1b78 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1313 microversion: 2.1 time: 0.158077 Aug 29 19:15:12.448144 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 549/1092] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:12 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:13.265924 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-bed77242-5899-4a82-b7b9-6815173e128c tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] Calling method '.version_select at 0x7f3d7651a820>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:13.316450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-bed77242-5899-4a82-b7b9-6815173e128c tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/77306961-8db5-43c4-ac14-5b0dac7f0bf2" status: 200 len: 351 microversion: 2.1 time: 0.054770 Aug 29 19:15:13.317025 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 544/1093] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:15:13 2022] GET /compute/v2.1/os-volumes/77306961-8db5-43c4-ac14-5b0dac7f0bf2 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:13.469114 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-94684efe-9d67-4563-a177-a86fe0bb97f0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:13.470005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-94684efe-9d67-4563-a177-a86fe0bb97f0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:13.478149 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-94684efe-9d67-4563-a177-a86fe0bb97f0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:13.478650 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-94684efe-9d67-4563-a177-a86fe0bb97f0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:13.479274 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-94684efe-9d67-4563-a177-a86fe0bb97f0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:13.480130 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-94684efe-9d67-4563-a177-a86fe0bb97f0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:13.480735 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-94684efe-9d67-4563-a177-a86fe0bb97f0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:13.481392 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-94684efe-9d67-4563-a177-a86fe0bb97f0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:13.511981 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:13.592913 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:13.610631 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=6 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:13.646509 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-94684efe-9d67-4563-a177-a86fe0bb97f0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:13.654866 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-94684efe-9d67-4563-a177-a86fe0bb97f0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1313 microversion: 2.1 time: 0.190405 Aug 29 19:15:13.655543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 550/1094] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:13 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:14.535064 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-64065e64-c95c-450c-a419-3c67a36f628a req-e7b2ecd4-03b2-4607-b875-95dfff0badde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5645a960-b066-4519-827b-8e5f6b530af8", "name": "network-vif-plugged", "status": "completed", "tag": "0fdcef63-1b7e-4793-86c3-12fcf85e7faa"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:14.542112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:14.552476 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-64065e64-c95c-450c-a419-3c67a36f628a req-e7b2ecd4-03b2-4607-b875-95dfff0badde service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:14.552974 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-64065e64-c95c-450c-a419-3c67a36f628a req-e7b2ecd4-03b2-4607-b875-95dfff0badde service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:14.553411 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-64065e64-c95c-450c-a419-3c67a36f628a req-e7b2ecd4-03b2-4607-b875-95dfff0badde service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:14.564886 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-64065e64-c95c-450c-a419-3c67a36f628a req-e7b2ecd4-03b2-4607-b875-95dfff0badde service nova] Creating event network-vif-plugged:0fdcef63-1b7e-4793-86c3-12fcf85e7faa for instance 5645a960-b066-4519-827b-8e5f6b530af8 on hv-cinder-73126 Aug 29 19:15:14.571600 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-64065e64-c95c-450c-a419-3c67a36f628a req-e7b2ecd4-03b2-4607-b875-95dfff0badde service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040811 Aug 29 19:15:14.572524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 545/1095] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:15:14.679216 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e6c49d2c-44c4-4212-b424-800eaf7a1a58 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:14.681091 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e6c49d2c-44c4-4212-b424-800eaf7a1a58 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:14.688333 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6c49d2c-44c4-4212-b424-800eaf7a1a58 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:14.688906 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6c49d2c-44c4-4212-b424-800eaf7a1a58 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:14.689295 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6c49d2c-44c4-4212-b424-800eaf7a1a58 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:14.690616 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6c49d2c-44c4-4212-b424-800eaf7a1a58 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:14.691241 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6c49d2c-44c4-4212-b424-800eaf7a1a58 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:14.691773 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e6c49d2c-44c4-4212-b424-800eaf7a1a58 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:14.700002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d78f6499-5a77-493d-afb6-1f9582d00db6 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] Calling method '.version_select at 0x7f3d762e6af0>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:14.753931 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d78f6499-5a77-493d-afb6-1f9582d00db6 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/65be813a-7fa9-4cb9-a7e0-310578730eba" status: 200 len: 349 microversion: 2.1 time: 0.058452 Aug 29 19:15:14.754507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 546/1096] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:15:14 2022] GET /compute/v2.1/os-volumes/65be813a-7fa9-4cb9-a7e0-310578730eba => generated 349 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:14.766868 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ceaa6020-27b7-49ce-adcb-a8ac02ba4f53 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] Calling method '.version_select at 0x7f3d764f83a0>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:14.855239 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ceaa6020-27b7-49ce-adcb-a8ac02ba4f53 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] 10.222.0.94 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.091914 Aug 29 19:15:14.856002 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 547/1097] 10.222.0.94 () {58 vars in 1134 bytes} [Mon Aug 29 19:15:14 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:14.870609 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7cc21737-2af4-460f-ac2f-8262ba54334f tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] Calling method '.version_select at 0x7f3d764f4280>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:14.891415 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-e6c49d2c-44c4-4212-b424-800eaf7a1a58 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:14.904131 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e6c49d2c-44c4-4212-b424-800eaf7a1a58 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1313 microversion: 2.1 time: 0.231216 Aug 29 19:15:14.905421 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 551/1098] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:14 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:14.966660 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7cc21737-2af4-460f-ac2f-8262ba54334f tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] 10.222.0.94 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.099909 Aug 29 19:15:14.967268 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 548/1099] 10.222.0.94 () {58 vars in 1149 bytes} [Mon Aug 29 19:15:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:15:14.980857 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-470ee25f-b70d-44ce-b985-266478e9c7f7 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] Calling method '.version_select at 0x7f3d76293b80>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:15.062986 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-470ee25f-b70d-44ce-b985-266478e9c7f7 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] 10.222.0.94 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.085814 Aug 29 19:15:15.063596 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 552/1100] 10.222.0.94 () {58 vars in 1134 bytes} [Mon Aug 29 19:15:14 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:15.076806 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-feed7844-da93-4287-a40b-26a1bade62b2 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] Calling method '.version_select at 0x7f3d7718ba60>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:15.160581 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-feed7844-da93-4287-a40b-26a1bade62b2 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] 10.222.0.94 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087498 Aug 29 19:15:15.161157 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 549/1101] 10.222.0.94 () {58 vars in 1167 bytes} [Mon Aug 29 19:15:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:15.174723 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-10079096-087b-40ed-a5b4-dd6c6c254f19 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] Calling method '.version_select at 0x7f3d76248b80>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:15.256944 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-10079096-087b-40ed-a5b4-dd6c6c254f19 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086656 Aug 29 19:15:15.257518 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 553/1102] 10.222.0.94 () {58 vars in 1170 bytes} [Mon Aug 29 19:15:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:15.270775 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8fe688e8-05b8-481e-8994-7f98cb56499c tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] Calling method '.version_select at 0x7f3d76410a60>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:15.353005 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8fe688e8-05b8-481e-8994-7f98cb56499c tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.086067 Aug 29 19:15:15.353580 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 550/1103] 10.222.0.94 () {58 vars in 1155 bytes} [Mon Aug 29 19:15:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:15.368862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5c091b1b-62b1-4a17-b44d-ce3cada6b8cd tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] Calling method '.version_select at 0x7f3d765cf700>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:15.454518 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5c091b1b-62b1-4a17-b44d-ce3cada6b8cd tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091096 Aug 29 19:15:15.455098 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 554/1104] 10.222.0.94 () {58 vars in 1188 bytes} [Mon Aug 29 19:15:15 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:15.468282 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-da0cdf90-45c2-435e-8b61-73aa84042e60 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] Calling method '.version_select at 0x7f3d76524430>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:15.555342 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-da0cdf90-45c2-435e-8b61-73aa84042e60 tempest-VolumesTestJSON-549608403 tempest-VolumesTestJSON-549608403-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.090713 Aug 29 19:15:15.555919 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 551/1105] 10.222.0.94 () {58 vars in 1155 bytes} [Mon Aug 29 19:15:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:15.926109 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5e57eddb-eacf-4a49-9777-a0238a142c64 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:15.926714 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5e57eddb-eacf-4a49-9777-a0238a142c64 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:15.933105 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e57eddb-eacf-4a49-9777-a0238a142c64 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:15.933595 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e57eddb-eacf-4a49-9777-a0238a142c64 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:15.934085 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e57eddb-eacf-4a49-9777-a0238a142c64 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:15.934791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e57eddb-eacf-4a49-9777-a0238a142c64 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:15.935279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e57eddb-eacf-4a49-9777-a0238a142c64 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:15.935761 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5e57eddb-eacf-4a49-9777-a0238a142c64 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:16.072924 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-5e57eddb-eacf-4a49-9777-a0238a142c64 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:16.082270 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5e57eddb-eacf-4a49-9777-a0238a142c64 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1313 microversion: 2.1 time: 0.160888 Aug 29 19:15:16.082899 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 555/1106] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:15 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:17.103467 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-df0a38ec-fb75-44c3-b392-a4de304a6ae9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:17.104203 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-df0a38ec-fb75-44c3-b392-a4de304a6ae9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:17.112878 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df0a38ec-fb75-44c3-b392-a4de304a6ae9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:17.113748 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df0a38ec-fb75-44c3-b392-a4de304a6ae9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:17.114522 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df0a38ec-fb75-44c3-b392-a4de304a6ae9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:17.115817 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df0a38ec-fb75-44c3-b392-a4de304a6ae9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:17.116623 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df0a38ec-fb75-44c3-b392-a4de304a6ae9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:17.117365 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-df0a38ec-fb75-44c3-b392-a4de304a6ae9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:17.253660 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-df0a38ec-fb75-44c3-b392-a4de304a6ae9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:17.261524 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-df0a38ec-fb75-44c3-b392-a4de304a6ae9 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1497 microversion: 2.1 time: 0.162434 Aug 29 19:15:17.262110 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 552/1107] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:17 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:17.887119 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e39cca4b-1886-485a-af54-48ac7df3760d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:17.887735 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e39cca4b-1886-485a-af54-48ac7df3760d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:17.894587 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e39cca4b-1886-485a-af54-48ac7df3760d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:17.895098 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e39cca4b-1886-485a-af54-48ac7df3760d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:17.895620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e39cca4b-1886-485a-af54-48ac7df3760d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:17.896325 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e39cca4b-1886-485a-af54-48ac7df3760d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:17.896788 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e39cca4b-1886-485a-af54-48ac7df3760d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:17.897394 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e39cca4b-1886-485a-af54-48ac7df3760d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:17.927199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e39cca4b-1886-485a-af54-48ac7df3760d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:15:18.005330 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e39cca4b-1886-485a-af54-48ac7df3760d tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "DELETE /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 204 len: 0 microversion: 2.1 time: 0.121785 Aug 29 19:15:18.005933 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 556/1108] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:15:17 2022] DELETE /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:15:18.015648 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-ef3bbaf6-4660-44dd-ad8f-33083e54c4b0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:18.016260 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-ef3bbaf6-4660-44dd-ad8f-33083e54c4b0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:18.022945 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3bbaf6-4660-44dd-ad8f-33083e54c4b0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:18.023466 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3bbaf6-4660-44dd-ad8f-33083e54c4b0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:18.023901 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3bbaf6-4660-44dd-ad8f-33083e54c4b0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:18.024645 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3bbaf6-4660-44dd-ad8f-33083e54c4b0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:18.025108 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3bbaf6-4660-44dd-ad8f-33083e54c4b0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:18.025535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-ef3bbaf6-4660-44dd-ad8f-33083e54c4b0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:18.158267 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-ef3bbaf6-4660-44dd-ad8f-33083e54c4b0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:18.167790 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-ef3bbaf6-4660-44dd-ad8f-33083e54c4b0 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1503 microversion: 2.1 time: 0.157311 Aug 29 19:15:18.168512 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 553/1109] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:18 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:19.190514 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-38af84fe-d830-4bb4-8c7d-fbe6dc970742 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:19.191246 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-38af84fe-d830-4bb4-8c7d-fbe6dc970742 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:19.197580 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-38af84fe-d830-4bb4-8c7d-fbe6dc970742 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:19.198073 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-38af84fe-d830-4bb4-8c7d-fbe6dc970742 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:19.198508 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-38af84fe-d830-4bb4-8c7d-fbe6dc970742 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:19.199428 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-38af84fe-d830-4bb4-8c7d-fbe6dc970742 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:19.199895 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-38af84fe-d830-4bb4-8c7d-fbe6dc970742 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:19.200328 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-38af84fe-d830-4bb4-8c7d-fbe6dc970742 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:19.337917 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-38af84fe-d830-4bb4-8c7d-fbe6dc970742 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:19.345708 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-38af84fe-d830-4bb4-8c7d-fbe6dc970742 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1503 microversion: 2.1 time: 0.159876 Aug 29 19:15:19.346547 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 557/1110] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:19 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:20.288299 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-94daccf5-0600-42dd-94d7-1165a484c831 req-03a8175d-0494-420a-83f8-10320f76bf84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5645a960-b066-4519-827b-8e5f6b530af8", "name": "network-vif-deleted", "tag": "0fdcef63-1b7e-4793-86c3-12fcf85e7faa"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:20.299872 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-94daccf5-0600-42dd-94d7-1165a484c831 req-03a8175d-0494-420a-83f8-10320f76bf84 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:20.300593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-94daccf5-0600-42dd-94d7-1165a484c831 req-03a8175d-0494-420a-83f8-10320f76bf84 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:20.301171 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-94daccf5-0600-42dd-94d7-1165a484c831 req-03a8175d-0494-420a-83f8-10320f76bf84 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:20.317600 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-94daccf5-0600-42dd-94d7-1165a484c831 req-03a8175d-0494-420a-83f8-10320f76bf84 service nova] Creating event network-vif-deleted:0fdcef63-1b7e-4793-86c3-12fcf85e7faa for instance 5645a960-b066-4519-827b-8e5f6b530af8 on hv-cinder-73126 Aug 29 19:15:20.320521 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-94daccf5-0600-42dd-94d7-1165a484c831 req-03a8175d-0494-420a-83f8-10320f76bf84 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036933 Aug 29 19:15:20.321273 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 554/1111] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:20.365791 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-78e4ebb8-7548-4c17-b14f-52a22def0ceb tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:20.366390 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-78e4ebb8-7548-4c17-b14f-52a22def0ceb tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:20.373099 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78e4ebb8-7548-4c17-b14f-52a22def0ceb tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:20.373585 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78e4ebb8-7548-4c17-b14f-52a22def0ceb tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:20.374192 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78e4ebb8-7548-4c17-b14f-52a22def0ceb tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:20.375060 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78e4ebb8-7548-4c17-b14f-52a22def0ceb tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:20.375710 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78e4ebb8-7548-4c17-b14f-52a22def0ceb tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:20.376297 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-78e4ebb8-7548-4c17-b14f-52a22def0ceb tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:20.451647 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-78e4ebb8-7548-4c17-b14f-52a22def0ceb tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:20.460951 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-78e4ebb8-7548-4c17-b14f-52a22def0ceb tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1298 microversion: 2.1 time: 0.098947 Aug 29 19:15:20.461562 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 558/1112] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:20 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:20.569874 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-aa011f74-a3b4-4398-af82-ea011f4f392d tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Action: 'create', calling method: .version_select at 0x7f3d764f4820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-493413547", "metadata": {"Type": "work"}}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-aa011f74-a3b4-4398-af82-ea011f4f392d tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Request method failure captured: Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 121 Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDRBIakVO5Sqss997Px62zKOHS6qc9IcmiX2CWdAn-nokUyHrEa-1FxBvAbw88ZelXat4fc7zPJq5rTZ8I1b3eCvZtRC9W3wIGH0et59FrzhAqb-VpMcAiiVKkZg21TqBhHil9TNz5TOcG_jfXgNIhRS2XUcfiGUZHUBvKxQj48wp6-g Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:20.581531 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}] Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: e07e729f54ec45e4ad472fd1739a606d Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-493413547", "metadata": {"Type": "work"}}} Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: Aug 29 19:15:20.583376 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-493413547', 'metadata': {'Type': 'work'}}}} Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise error Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:20.584719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 19:15:20.586224 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 19:15:20.588015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 19:15:20.588015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.588015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-aa011f74-a3b4-4398-af82-ea011f4f392d tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:20.588015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-aa011f74-a3b4-4398-af82-ea011f4f392d tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.138070 Aug 29 19:15:20.588015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 555/1113] 10.222.0.94 () {60 vars in 1156 bytes} [Mon Aug 29 19:15:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 19:15:20.592522 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-27b202e2-0455-4807-9396-1d1b42638d23 tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Action: 'create', calling method: .version_select at 0x7f3d76248e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-500600260", "metadata": {"Type": "work"}}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-27b202e2-0455-4807-9396-1d1b42638d23 tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Request method failure captured: Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 119 Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDRBIakVO5Sqss997Px62zKOHS6qc9IcmiX2CWdAn-nokUyHrEa-1FxBvAbw88ZelXat4fc7zPJq5rTZ8I1b3eCvZtRC9W3wIGH0et59FrzhAqb-VpMcAiiVKkZg21TqBhHil9TNz5TOcG_jfXgNIhRS2XUcfiGUZHUBvKxQj48wp6-g Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:15:20.597651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}] Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: e07e729f54ec45e4ad472fd1739a606d Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-500600260", "metadata": {"Type": "work"}}} Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: Aug 29 19:15:20.599349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-500600260', 'metadata': {'Type': 'work'}}}} Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise error Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi '0' Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:20.600340 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 19:15:20.602044 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 19:15:20.603554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 19:15:20.603554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.603554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-27b202e2-0455-4807-9396-1d1b42638d23 tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:20.603554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-27b202e2-0455-4807-9396-1d1b42638d23 tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010287 Aug 29 19:15:20.603554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 559/1114] 10.222.0.94 () {60 vars in 1156 bytes} [Mon Aug 29 19:15:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 29 19:15:20.609050 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c8e2afc8-088d-4058-9c9b-cdf7579ef89f tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Action: 'create', calling method: .version_select at 0x7f3d764f8280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1808927227", "metadata": {"Type": "work"}}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c8e2afc8-088d-4058-9c9b-cdf7579ef89f tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Request method failure captured: Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 119 Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDRBIakVO5Sqss997Px62zKOHS6qc9IcmiX2CWdAn-nokUyHrEa-1FxBvAbw88ZelXat4fc7zPJq5rTZ8I1b3eCvZtRC9W3wIGH0et59FrzhAqb-VpMcAiiVKkZg21TqBhHil9TNz5TOcG_jfXgNIhRS2XUcfiGUZHUBvKxQj48wp6-g Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:20.613420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}] Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: e07e729f54ec45e4ad472fd1739a606d Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1808927227", "metadata": {"Type": "work"}}} Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: Aug 29 19:15:20.615135 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1808927227', 'metadata': {'Type': 'work'}}}} Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise error Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi '' Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:20.616104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 19:15:20.617739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 19:15:20.619160 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 19:15:20.619160 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.619160 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c8e2afc8-088d-4058-9c9b-cdf7579ef89f tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:20.619160 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c8e2afc8-088d-4058-9c9b-cdf7579ef89f tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] 10.222.0.94 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009913 Aug 29 19:15:20.619160 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 556/1115] 10.222.0.94 () {60 vars in 1156 bytes} [Mon Aug 29 19:15:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:15:20.624581 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b8c636c0-3eb3-4ae4-9dbf-4827024956ec tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Calling method '.version_select at 0x7f3d762b2700>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:20.654532 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-b8c636c0-3eb3-4ae4-9dbf-4827024956ec tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] HTTP exception thrown: Volume tempest-invalid-1891075030 could not be found. Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b8c636c0-3eb3-4ae4-9dbf-4827024956ec tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Request method failure captured: Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1891075030 HTTP/1.1 Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDRBIakVO5Sqss997Px62zKOHS6qc9IcmiX2CWdAn-nokUyHrEa-1FxBvAbw88ZelXat4fc7zPJq5rTZ8I1b3eCvZtRC9W3wIGH0et59FrzhAqb-VpMcAiiVKkZg21TqBhHil9TNz5TOcG_jfXgNIhRS2XUcfiGUZHUBvKxQj48wp6-g Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:15:20.656600 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}] Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: e07e729f54ec45e4ad472fd1739a606d Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Volume tempest-invalid-1891075030 could not be found. Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': 'tempest-invalid-1891075030'} Aug 29 19:15:20.658196 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1891075030 could not be found. (HTTP 404) (Request-ID: req-c3f24006-9486-4744-8984-e0c8c82f3bdf) Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.659639 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:15:20.660922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1891075030 could not be found. Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:20.662095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1891075030 could not be found. Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1891075030 could not be found. Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b8c636c0-3eb3-4ae4-9dbf-4827024956ec tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Returning 404 to user: Volume tempest-invalid-1891075030 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b8c636c0-3eb3-4ae4-9dbf-4827024956ec tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1891075030" status: 404 len: 99 microversion: 2.1 time: 0.037293 Aug 29 19:15:20.663614 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 560/1116] 10.222.0.94 () {58 vars in 1218 bytes} [Mon Aug 29 19:15:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1891075030 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 19:15:20.669006 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-91085bdd-8048-4d53-8e3c-a213d3262f7f tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003815 Aug 29 19:15:20.669513 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 557/1117] 10.222.0.94 () {58 vars in 1140 bytes} [Mon Aug 29 19:15:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 19:15:20.678641 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-aabc2fd6-f37f-4489-be81-c76311f33e90 tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004378 Aug 29 19:15:20.679211 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 561/1118] 10.222.0.94 () {58 vars in 1137 bytes} [Mon Aug 29 19:15:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 19:15:20.687392 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-543b1cf6-b72e-4582-a68a-395ae7294358 tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Calling method '.version_select at 0x7f3d764f84c0>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:20.715615 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-543b1cf6-b72e-4582-a68a-395ae7294358 tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] HTTP exception thrown: Volume d4b694c8-efcb-400c-a5ee-41b13fa662d9 could not be found. Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-543b1cf6-b72e-4582-a68a-395ae7294358 tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Request method failure captured: Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: DELETE /compute/v2.1/os-volumes/d4b694c8-efcb-400c-a5ee-41b13fa662d9 HTTP/1.1 Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDRBIakVO5Sqss997Px62zKOHS6qc9IcmiX2CWdAn-nokUyHrEa-1FxBvAbw88ZelXat4fc7zPJq5rTZ8I1b3eCvZtRC9W3wIGH0et59FrzhAqb-VpMcAiiVKkZg21TqBhHil9TNz5TOcG_jfXgNIhRS2XUcfiGUZHUBvKxQj48wp6-g Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:20.717601 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}] Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: e07e729f54ec45e4ad472fd1739a606d Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Volume d4b694c8-efcb-400c-a5ee-41b13fa662d9 could not be found. Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': 'd4b694c8-efcb-400c-a5ee-41b13fa662d9'} Aug 29 19:15:20.719240 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d4b694c8-efcb-400c-a5ee-41b13fa662d9 could not be found. (HTTP 404) (Request-ID: req-5d617ff0-df01-4d84-b5ba-00ac24408ddb) Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.720259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 19:15:20.722194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d4b694c8-efcb-400c-a5ee-41b13fa662d9 could not be found. Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 19:15:20.724116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d4b694c8-efcb-400c-a5ee-41b13fa662d9 could not be found. Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d4b694c8-efcb-400c-a5ee-41b13fa662d9 could not be found. Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-543b1cf6-b72e-4582-a68a-395ae7294358 tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Returning 404 to user: Volume d4b694c8-efcb-400c-a5ee-41b13fa662d9 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-543b1cf6-b72e-4582-a68a-395ae7294358 tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] 10.222.0.94 "DELETE /compute/v2.1/os-volumes/d4b694c8-efcb-400c-a5ee-41b13fa662d9" status: 404 len: 109 microversion: 2.1 time: 0.035244 Aug 29 19:15:20.725571 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 558/1119] 10.222.0.94 () {58 vars in 1248 bytes} [Mon Aug 29 19:15:20 2022] DELETE /compute/v2.1/os-volumes/d4b694c8-efcb-400c-a5ee-41b13fa662d9 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:15:20.729313 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-73d9cecd-800e-47f3-a538-bbbddef6a90b tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Calling method '.version_select at 0x7f3d7625a310>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:20.757836 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-73d9cecd-800e-47f3-a538-bbbddef6a90b tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] HTTP exception thrown: Volume f6c449e6-ffe7-446b-8356-be3905e175f2 could not be found. Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-73d9cecd-800e-47f3-a538-bbbddef6a90b tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Request method failure captured: Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/os-volumes/f6c449e6-ffe7-446b-8356-be3905e175f2 HTTP/1.1 Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDRBIakVO5Sqss997Px62zKOHS6qc9IcmiX2CWdAn-nokUyHrEa-1FxBvAbw88ZelXat4fc7zPJq5rTZ8I1b3eCvZtRC9W3wIGH0et59FrzhAqb-VpMcAiiVKkZg21TqBhHil9TNz5TOcG_jfXgNIhRS2XUcfiGUZHUBvKxQj48wp6-g Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:15:20.759862 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/3ff89830f9b344129fe765c46da1ce88"}]}] Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 3ff89830f9b344129fe765c46da1ce88 Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-VolumesNegativeTest-415656682 Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: e07e729f54ec45e4ad472fd1739a606d Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-VolumesNegativeTest-415656682-project Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Volume f6c449e6-ffe7-446b-8356-be3905e175f2 could not be found. Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': 'f6c449e6-ffe7-446b-8356-be3905e175f2'} Aug 29 19:15:20.761482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6c449e6-ffe7-446b-8356-be3905e175f2 could not be found. (HTTP 404) (Request-ID: req-83e03d1c-23e6-470d-bb76-3b253bad3e17) Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.762498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 19:15:20.763934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6c449e6-ffe7-446b-8356-be3905e175f2 could not be found. Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 19:15:20.765226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6c449e6-ffe7-446b-8356-be3905e175f2 could not be found. Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6c449e6-ffe7-446b-8356-be3905e175f2 could not be found. Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-73d9cecd-800e-47f3-a538-bbbddef6a90b tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] Returning 404 to user: Volume f6c449e6-ffe7-446b-8356-be3905e175f2 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-73d9cecd-800e-47f3-a538-bbbddef6a90b tempest-VolumesNegativeTest-415656682 tempest-VolumesNegativeTest-415656682-project] 10.222.0.94 "GET /compute/v2.1/os-volumes/f6c449e6-ffe7-446b-8356-be3905e175f2" status: 404 len: 109 microversion: 2.1 time: 0.035730 Aug 29 19:15:20.766651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 562/1120] 10.222.0.94 () {58 vars in 1245 bytes} [Mon Aug 29 19:15:20 2022] GET /compute/v2.1/os-volumes/f6c449e6-ffe7-446b-8356-be3905e175f2 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:15:21.483487 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:21.484326 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:21.491808 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:21.492281 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:21.492900 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:21.493589 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:21.494050 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:21.494448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:21.531606 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:21.532094 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:21.532911 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:21.533362 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lazy-loading 'fault' on Instance uuid 5645a960-b066-4519-827b-8e5f6b530af8 {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:15:21.577420 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:21.585676 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fc677398-28b4-40bc-a6ee-9db1e6f4f215 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1303 microversion: 2.1 time: 0.106632 Aug 29 19:15:21.586225 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 559/1121] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:21 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:22.609873 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:22.610422 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:22.618127 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:22.618625 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:22.619063 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:22.619812 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:22.620279 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:22.620698 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:22.653100 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:22.653808 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:22.654254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:22.654702 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lazy-loading 'fault' on Instance uuid 5645a960-b066-4519-827b-8e5f6b530af8 {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:15:22.699663 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bccc502170e349e0848922712c574ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcda882db7046eab245492bc4c4d7e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:22.707346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1efb1856-39f7-410c-a87f-1cd98ddf8ad1 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 200 len: 1303 microversion: 2.1 time: 0.103521 Aug 29 19:15:22.707920 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 563/1122] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:22 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:23.728690 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:23.729303 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] [instance: 5645a960-b066-4519-827b-8e5f6b530af8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:23.735803 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:23.736332 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:23.737474 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:23.738381 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:23.738840 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:23.739303 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:23.753809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] HTTP exception thrown: Instance 5645a960-b066-4519-827b-8e5f6b530af8 could not be found. Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Request method failure captured: Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 HTTP/1.1 Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDRAXMeIhBQMzA33PKqleBKB44FdLzxKE2alGchrIP20msN7tGTpLOitTzXK34PBoMduH44HKbyonRyk5rVM46nYTZfl3cDWNbWel5GzG9Z4BD_KuEs-BNMk1T16cC17WdPHeJGB1fHWJziJZzrVDABj8vWKIw26NxOILG9l7fmz0_i8 Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: abcda882db7046eab245492bc4c4d7e6 Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-VolumesActionsTest-1621171274 Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:23.755458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/abcda882db7046eab245492bc4c4d7e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_abcda882db7046eab245492bc4c4d7e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/abcda882db7046eab245492bc4c4d7e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/abcda882db7046eab245492bc4c4d7e6"}]}] Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-VolumesActionsTest-1621171274 Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: abcda882db7046eab245492bc4c4d7e6 Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-VolumesActionsTest-1621171274 Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-VolumesActionsTest-1621171274-project Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: bccc502170e349e0848922712c574ca7 Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-VolumesActionsTest-1621171274-project Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 5645a960-b066-4519-827b-8e5f6b530af8 could not be found. Aug 29 19:15:23.757017 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '5645a960-b066-4519-827b-8e5f6b530af8'} Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5645a960-b066-4519-827b-8e5f6b530af8 could not be found. Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:23.757923 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5645a960-b066-4519-827b-8e5f6b530af8 could not be found. Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5645a960-b066-4519-827b-8e5f6b530af8 could not be found. Aug 29 19:15:23.759389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:23.761048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] Returning 404 to user: Instance 5645a960-b066-4519-827b-8e5f6b530af8 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:23.761048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-eb0da43f-1035-400a-a085-2409a97e9f23 tempest-VolumesActionsTest-1621171274 tempest-VolumesActionsTest-1621171274-project] 10.222.0.94 "GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8" status: 404 len: 111 microversion: 2.1 time: 0.032130 Aug 29 19:15:23.761048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 560/1123] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:23 2022] GET /compute/v2.1/servers/5645a960-b066-4519-827b-8e5f6b530af8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:15:40.458392 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-a5ea056d-c404-4624-9a9d-6a1c5c443c07 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:40.458938 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a5ea056d-c404-4624-9a9d-6a1c5c443c07 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:40.461418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:40.462029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:40.480216 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-670849b6-634c-4417-8d89-29f1f74351d1 req-324454fc-6f93-4423-9f3e-5512dd9b452a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337970a7-0d96-4590-bbf0-e7e1b2fae6ac", "tag": "bc2fe8d5-1c6f-407b-8613-774dc48866ca"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:40.482924 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a5ea056d-c404-4624-9a9d-6a1c5c443c07 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:40.483681 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a5ea056d-c404-4624-9a9d-6a1c5c443c07 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:40.484370 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a5ea056d-c404-4624-9a9d-6a1c5c443c07 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:40.485644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a5ea056d-c404-4624-9a9d-6a1c5c443c07 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:40.486305 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a5ea056d-c404-4624-9a9d-6a1c5c443c07 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:40.487254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-a5ea056d-c404-4624-9a9d-6a1c5c443c07 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:40.518150 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=35 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:40.520832 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-a5ea056d-c404-4624-9a9d-6a1c5c443c07 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:15:40.522986 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=38 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:15:40.528090 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-670849b6-634c-4417-8d89-29f1f74351d1 req-324454fc-6f93-4423-9f3e-5512dd9b452a service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:40.528730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-670849b6-634c-4417-8d89-29f1f74351d1 req-324454fc-6f93-4423-9f3e-5512dd9b452a service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:40.529324 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-670849b6-634c-4417-8d89-29f1f74351d1 req-324454fc-6f93-4423-9f3e-5512dd9b452a service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:40.580549 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-670849b6-634c-4417-8d89-29f1f74351d1 req-324454fc-6f93-4423-9f3e-5512dd9b452a service nova] Creating event network-changed:bc2fe8d5-1c6f-407b-8613-774dc48866ca for instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac on hv-cinder-73126 Aug 29 19:15:40.598481 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-670849b6-634c-4417-8d89-29f1f74351d1 req-324454fc-6f93-4423-9f3e-5512dd9b452a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133293 Aug 29 19:15:40.599852 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 561/1124] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:40.665870 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-a5ea056d-c404-4624-9a9d-6a1c5c443c07 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "DELETE /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 204 len: 0 microversion: 2.1 time: 0.211861 Aug 29 19:15:40.668214 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 564/1125] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:15:40 2022] DELETE /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:15:40.677361 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-213fc7d9-6895-4663-858f-294cd439cb58 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:40.678331 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-213fc7d9-6895-4663-858f-294cd439cb58 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:40.685232 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-213fc7d9-6895-4663-858f-294cd439cb58 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:40.685945 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-213fc7d9-6895-4663-858f-294cd439cb58 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:40.686545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-213fc7d9-6895-4663-858f-294cd439cb58 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:40.687544 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-213fc7d9-6895-4663-858f-294cd439cb58 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:40.688211 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-213fc7d9-6895-4663-858f-294cd439cb58 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:40.688835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-213fc7d9-6895-4663-858f-294cd439cb58 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:40.903628 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-213fc7d9-6895-4663-858f-294cd439cb58 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:40.913197 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-213fc7d9-6895-4663-858f-294cd439cb58 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.240684 Aug 29 19:15:40.914092 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 562/1126] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:40 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:41.934656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1fb3a5e4-24fe-4f4a-9189-6a6b1284af7e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:41.935480 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1fb3a5e4-24fe-4f4a-9189-6a6b1284af7e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:41.942491 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1fb3a5e4-24fe-4f4a-9189-6a6b1284af7e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:41.942974 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1fb3a5e4-24fe-4f4a-9189-6a6b1284af7e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:41.943423 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1fb3a5e4-24fe-4f4a-9189-6a6b1284af7e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:41.944195 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1fb3a5e4-24fe-4f4a-9189-6a6b1284af7e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:41.944554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1fb3a5e4-24fe-4f4a-9189-6a6b1284af7e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:41.944974 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1fb3a5e4-24fe-4f4a-9189-6a6b1284af7e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:42.095339 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1fb3a5e4-24fe-4f4a-9189-6a6b1284af7e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:42.104108 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1fb3a5e4-24fe-4f4a-9189-6a6b1284af7e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.173570 Aug 29 19:15:42.104746 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 565/1127] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:41 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:43.126204 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9f666b05-87e4-4cfb-a8e5-867ec360905b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:43.126818 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9f666b05-87e4-4cfb-a8e5-867ec360905b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:43.133193 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f666b05-87e4-4cfb-a8e5-867ec360905b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:43.133675 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f666b05-87e4-4cfb-a8e5-867ec360905b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:43.134113 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f666b05-87e4-4cfb-a8e5-867ec360905b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:43.134797 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f666b05-87e4-4cfb-a8e5-867ec360905b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:43.135280 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f666b05-87e4-4cfb-a8e5-867ec360905b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:43.135706 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9f666b05-87e4-4cfb-a8e5-867ec360905b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:43.304733 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9f666b05-87e4-4cfb-a8e5-867ec360905b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:43.312452 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9f666b05-87e4-4cfb-a8e5-867ec360905b tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.190401 Aug 29 19:15:43.313009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 563/1128] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:43 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:44.337931 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-43e97676-1be6-4e42-851d-924599aa039d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:44.339296 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-43e97676-1be6-4e42-851d-924599aa039d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:44.346048 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-43e97676-1be6-4e42-851d-924599aa039d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:44.347445 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-43e97676-1be6-4e42-851d-924599aa039d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:44.348134 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-43e97676-1be6-4e42-851d-924599aa039d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:44.349073 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-43e97676-1be6-4e42-851d-924599aa039d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:44.349753 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-43e97676-1be6-4e42-851d-924599aa039d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:44.350453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-43e97676-1be6-4e42-851d-924599aa039d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:44.547802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-43e97676-1be6-4e42-851d-924599aa039d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:44.562680 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-43e97676-1be6-4e42-851d-924599aa039d tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.231597 Aug 29 19:15:44.563911 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 566/1129] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:44 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:45.597789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7fce0190-7078-4fe0-9f89-991ff5de106f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:45.599338 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7fce0190-7078-4fe0-9f89-991ff5de106f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:45.611536 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7fce0190-7078-4fe0-9f89-991ff5de106f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:45.614574 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7fce0190-7078-4fe0-9f89-991ff5de106f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:45.616050 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7fce0190-7078-4fe0-9f89-991ff5de106f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:45.617708 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7fce0190-7078-4fe0-9f89-991ff5de106f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:45.618603 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7fce0190-7078-4fe0-9f89-991ff5de106f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:45.621809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7fce0190-7078-4fe0-9f89-991ff5de106f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:45.918705 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7fce0190-7078-4fe0-9f89-991ff5de106f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:45.929947 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7fce0190-7078-4fe0-9f89-991ff5de106f tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1569 microversion: 2.1 time: 0.337071 Aug 29 19:15:45.930488 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 564/1130] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:45 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1569 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:46.142759 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-999a2b74-4c50-409b-93ab-18e2ba15128d req-cb55d918-8c42-45be-93f2-d2f4b240c953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337970a7-0d96-4590-bbf0-e7e1b2fae6ac", "name": "network-vif-deleted", "tag": "bc2fe8d5-1c6f-407b-8613-774dc48866ca"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:46.158361 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-999a2b74-4c50-409b-93ab-18e2ba15128d req-cb55d918-8c42-45be-93f2-d2f4b240c953 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:46.158841 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-999a2b74-4c50-409b-93ab-18e2ba15128d req-cb55d918-8c42-45be-93f2-d2f4b240c953 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:46.159810 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-999a2b74-4c50-409b-93ab-18e2ba15128d req-cb55d918-8c42-45be-93f2-d2f4b240c953 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:46.197199 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-999a2b74-4c50-409b-93ab-18e2ba15128d req-cb55d918-8c42-45be-93f2-d2f4b240c953 service nova] Creating event network-vif-deleted:bc2fe8d5-1c6f-407b-8613-774dc48866ca for instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac on hv-cinder-73126 Aug 29 19:15:46.202989 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-999a2b74-4c50-409b-93ab-18e2ba15128d req-cb55d918-8c42-45be-93f2-d2f4b240c953 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064812 Aug 29 19:15:46.204401 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 567/1131] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:46.954678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0989f69a-4295-4994-aa4a-d1882f4b236e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:46.955312 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0989f69a-4295-4994-aa4a-d1882f4b236e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:46.962725 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0989f69a-4295-4994-aa4a-d1882f4b236e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:46.963305 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0989f69a-4295-4994-aa4a-d1882f4b236e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:46.963765 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0989f69a-4295-4994-aa4a-d1882f4b236e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:46.964730 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0989f69a-4295-4994-aa4a-d1882f4b236e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:46.965449 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0989f69a-4295-4994-aa4a-d1882f4b236e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:46.966078 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0989f69a-4295-4994-aa4a-d1882f4b236e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:47.039415 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0989f69a-4295-4994-aa4a-d1882f4b236e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:47.047370 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0989f69a-4295-4994-aa4a-d1882f4b236e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1219 microversion: 2.1 time: 0.097349 Aug 29 19:15:47.047966 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 565/1132] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:46 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:47.476227 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6bed80ed-28c5-4bf5-bba7-d6169e07d2c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:47.478501 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6bed80ed-28c5-4bf5-bba7-d6169e07d2c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:47.484819 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6bed80ed-28c5-4bf5-bba7-d6169e07d2c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:47.485333 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6bed80ed-28c5-4bf5-bba7-d6169e07d2c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:47.485770 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6bed80ed-28c5-4bf5-bba7-d6169e07d2c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:47.486462 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6bed80ed-28c5-4bf5-bba7-d6169e07d2c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:47.486916 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6bed80ed-28c5-4bf5-bba7-d6169e07d2c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:47.487429 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6bed80ed-28c5-4bf5-bba7-d6169e07d2c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:47.519476 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6bed80ed-28c5-4bf5-bba7-d6169e07d2c8 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048540 Aug 29 19:15:47.520056 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 568/1133] 10.222.0.94 () {60 vars in 1343 bytes} [Mon Aug 29 19:15:47 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:15:47.623623 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-91a4d4b1-c6e1-4ae8-ac9e-f8f412c0d39f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:47.624119 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-91a4d4b1-c6e1-4ae8-ac9e-f8f412c0d39f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:47.631138 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-91a4d4b1-c6e1-4ae8-ac9e-f8f412c0d39f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:47.631631 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-91a4d4b1-c6e1-4ae8-ac9e-f8f412c0d39f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:47.632068 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-91a4d4b1-c6e1-4ae8-ac9e-f8f412c0d39f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:47.632770 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-91a4d4b1-c6e1-4ae8-ac9e-f8f412c0d39f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:47.633300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-91a4d4b1-c6e1-4ae8-ac9e-f8f412c0d39f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:47.633757 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-91a4d4b1-c6e1-4ae8-ac9e-f8f412c0d39f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:47.660456 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-91a4d4b1-c6e1-4ae8-ac9e-f8f412c0d39f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Going to try to terminate instance {{(pid=115968) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:15:47.742755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-91a4d4b1-c6e1-4ae8-ac9e-f8f412c0d39f tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "DELETE /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 204 len: 0 microversion: 2.20 time: 0.122377 Aug 29 19:15:47.743686 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 566/1134] 10.222.0.94 () {60 vars in 1280 bytes} [Mon Aug 29 19:15:47 2022] DELETE /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 19:15:47.752136 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:47.752752 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:47.759556 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:47.760046 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:47.760521 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:47.761415 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:47.762049 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:47.762742 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:47.909009 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:47.918485 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:47.919976 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:47.921366 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f7d02029-d11a-4941-89ae-cde962c736da tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.173146 Aug 29 19:15:47.921925 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 569/1135] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:15:47 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:15:48.070068 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:48.070801 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:48.077337 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:48.077819 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:48.078432 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:48.079332 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:48.079779 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:48.080638 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:48.115047 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:48.115560 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:48.115994 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:48.116446 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lazy-loading 'fault' on Instance uuid 337970a7-0d96-4590-bbf0-e7e1b2fae6ac {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:15:48.166429 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:48.176407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d438e65e-8809-4604-9fe3-5e4c91d8cb25 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1224 microversion: 2.1 time: 0.111207 Aug 29 19:15:48.177022 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 567/1136] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:48 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:48.504499 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-419641329", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1804926399", "security_groups": [{"name": "tempest-secgroup-smoke-805233569"}], "block_device_mapping_v2": [{"uuid": "d136b930-4cdf-424f-b19c-eb9d9e376a50", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e57e46be-ed2c-4b43-aa10-cfbdcaee4566"}]}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:48.748688 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.network.neutron [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] validate_networks() for [('e57e46be-ed2c-4b43-aa10-cfbdcaee4566', None, None, None, None, None)] {{(pid=115967) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:15:48.946335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:48.947041 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:48.956941 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:48.971572 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:48.975541 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:48.976339 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:48.977246 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:48.980611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:49.497048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:49.507791 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:49.510588 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:49.524691 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6013e4f3-868d-42a9-8f2b-013e64a8bb4e tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.582648 Aug 29 19:15:49.525312 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 568/1137] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:15:48 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:15:49.530188 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:49.530793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:49.548246 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:49.549596 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:49.551561 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:49.553178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:49.555538 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:49.556120 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:49.637546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:49.638387 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:49.639054 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:49.639938 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.objects.instance [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lazy-loading 'fault' on Instance uuid 337970a7-0d96-4590-bbf0-e7e1b2fae6ac {{(pid=115968) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:15:49.722715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82fb5d585b5d460bb258f929057a4093', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f4bcf841c942a9928f5b343b5fb8bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:49.732398 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5c041b11-b151-453c-86af-b6d9c7a5ef15 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 200 len: 1224 microversion: 2.1 time: 0.205705 Aug 29 19:15:49.732970 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 569/1138] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:49 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 1224 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:49.767490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Flavor limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:15:49.767988 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Image limits 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:15:49.768390 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Flavor pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:15:49.769456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Image pref 0:0:0 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:15:49.769885 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.virt.hardware [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:15:49.778814 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:49.779341 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:49.779779 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:49.780510 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:49.780998 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:49.781429 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:49.798033 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Getting quotas for project 6a4d940594f542808602c7260993f85f. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:15:49.802582 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Getting quotas for user 8f1c0b2189a041fdb8dbe2a0290ffac8 and project 6a4d940594f542808602c7260993f85f. Resources: {'cores', 'ram', 'instances'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:15:49.865771 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Going to run 1 instances... {{(pid=115967) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:15:49.867993 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d136b930-4cdf-424f-b19c-eb9d9e376a50',volume_size=None,volume_type=None)] {{(pid=115967) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:15:50.046335 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-41e051b4-2f1f-43c0-a7da-6c168976d989 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.546654 Aug 29 19:15:50.058564 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 570/1139] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:15:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 1562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:15:50.070906 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fcaacc6e-8ad0-48cc-a266-edfd2a3f3aaf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:50.074034 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fcaacc6e-8ad0-48cc-a266-edfd2a3f3aaf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:50.261536 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fcaacc6e-8ad0-48cc-a266-edfd2a3f3aaf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:50.275515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fcaacc6e-8ad0-48cc-a266-edfd2a3f3aaf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1094 microversion: 2.1 time: 0.217305 Aug 29 19:15:50.278456 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 570/1140] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:50 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1094 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:50.556716 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:50.558091 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:50.589070 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:50.589840 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:50.591734 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:50.595594 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:50.596431 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:50.598897 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:50.754941 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:50.755704 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] [instance: 337970a7-0d96-4590-bbf0-e7e1b2fae6ac] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:50.768116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:50.771689 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:50.772207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:50.773771 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:50.774440 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:50.774829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:50.797837 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] HTTP exception thrown: Instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac could not be found. Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Request method failure captured: Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac HTTP/1.1 Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ8EgquMwpXiaU8C7h-zqHJpABK9Rxa197bkJNVvc_frxL7_T4p29rQHriVwh-oiuk7Q_6pSSgwdzX47HW8j2DkMYuZ7dAoQGLqsm0zOXY7hxuSBlTJ_OpuIC3xnDDE2mAcr-Ovx5MKANeyZKtqIofKF0j06K3ukN3Ni2V5Yqtu5C8k Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: f0f4bcf841c942a9928f5b343b5fb8bb Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-TestShelveInstance-105742100 Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:15:50.801155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/f0f4bcf841c942a9928f5b343b5fb8bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_f0f4bcf841c942a9928f5b343b5fb8bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/f0f4bcf841c942a9928f5b343b5fb8bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/f0f4bcf841c942a9928f5b343b5fb8bb"}]}] Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-TestShelveInstance-105742100 Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: f0f4bcf841c942a9928f5b343b5fb8bb Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-TestShelveInstance-105742100 Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-TestShelveInstance-105742100-project Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 82fb5d585b5d460bb258f929057a4093 Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-TestShelveInstance-105742100-project Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac could not be found. Aug 29 19:15:50.803169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '337970a7-0d96-4590-bbf0-e7e1b2fae6ac'} Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac could not be found. Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:50.804300 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac could not be found. Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac could not be found. Aug 29 19:15:50.806178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:15:50.808712 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Returning 404 to user: Instance 337970a7-0d96-4590-bbf0-e7e1b2fae6ac could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:50.810086 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-abc7e80b-f49a-4453-8b70-aa8c219d683e tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac" status: 404 len: 111 microversion: 2.1 time: 0.059983 Aug 29 19:15:50.826140 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 571/1141] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:50 2022] GET /compute/v2.1/servers/337970a7-0d96-4590-bbf0-e7e1b2fae6ac => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:15:51.039672 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e8f6812c-da1b-4ac7-83ef-b1bb3b8f14b0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] Calling method '.version_select at 0x7f3d7624fc10>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:51.090441 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e8f6812c-da1b-4ac7-83ef-b1bb3b8f14b0 tempest-TestShelveInstance-105742100 tempest-TestShelveInstance-105742100-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1218624179" status: 202 len: 0 microversion: 2.1 time: 0.054964 Aug 29 19:15:51.106600 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 572/1142] 10.222.0.94 () {58 vars in 1254 bytes} [Mon Aug 29 19:15:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1218624179 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:15:51.274514 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:51.289703 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:51.301823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-946a97bf-c451-43c0-a46c-d6c4344f7631 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:51.302565 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-946a97bf-c451-43c0-a46c-d6c4344f7631 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:51.305088 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:51.309889 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3ebe6297-aa5e-4420-8af3-ba783189be2c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1725 microversion: 2.20 time: 0.758583 Aug 29 19:15:51.313529 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 571/1143] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:15:50 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1725 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:15:51.319581 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-946a97bf-c451-43c0-a46c-d6c4344f7631 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:51.320729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-946a97bf-c451-43c0-a46c-d6c4344f7631 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:51.321429 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-946a97bf-c451-43c0-a46c-d6c4344f7631 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:51.322653 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-946a97bf-c451-43c0-a46c-d6c4344f7631 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:51.323713 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-946a97bf-c451-43c0-a46c-d6c4344f7631 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:51.324289 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-946a97bf-c451-43c0-a46c-d6c4344f7631 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:51.436523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-946a97bf-c451-43c0-a46c-d6c4344f7631 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:51.478209 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-946a97bf-c451-43c0-a46c-d6c4344f7631 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1192 microversion: 2.1 time: 0.183314 Aug 29 19:15:51.479600 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 573/1144] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:51 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1192 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:52.342358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:52.343633 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:52.362666 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:52.365209 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:52.367540 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:52.370374 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:52.371683 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:52.374919 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:52.479838 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-54531796-abdd-414a-8eaf-2aabfe81e82d req-436944ed-fb4d-4d17-9cd0-eb42777bb093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9713d174-1918-4168-b6e7-bf1359b50155", "name": "network-vif-deleted", "tag": "d4371ad0-840e-40ed-b29d-5fdc435f7837"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:52.509194 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-54531796-abdd-414a-8eaf-2aabfe81e82d req-436944ed-fb4d-4d17-9cd0-eb42777bb093 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:52.510040 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-54531796-abdd-414a-8eaf-2aabfe81e82d req-436944ed-fb4d-4d17-9cd0-eb42777bb093 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:52.510476 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-54531796-abdd-414a-8eaf-2aabfe81e82d req-436944ed-fb4d-4d17-9cd0-eb42777bb093 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:52.537116 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-54531796-abdd-414a-8eaf-2aabfe81e82d req-436944ed-fb4d-4d17-9cd0-eb42777bb093 service nova] Creating event network-vif-deleted:d4371ad0-840e-40ed-b29d-5fdc435f7837 for instance 9713d174-1918-4168-b6e7-bf1359b50155 on hv-cinder-73126 Aug 29 19:15:52.552040 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-54531796-abdd-414a-8eaf-2aabfe81e82d req-436944ed-fb4d-4d17-9cd0-eb42777bb093 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075409 Aug 29 19:15:52.554347 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 574/1145] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:15:52.572084 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-989160f4-4436-4186-bede-8b779585ca62 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:52.580791 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-989160f4-4436-4186-bede-8b779585ca62 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:52.596132 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:52.599039 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-989160f4-4436-4186-bede-8b779585ca62 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:52.599825 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-989160f4-4436-4186-bede-8b779585ca62 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:52.600441 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-989160f4-4436-4186-bede-8b779585ca62 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:52.601315 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-989160f4-4436-4186-bede-8b779585ca62 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:52.601926 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-989160f4-4436-4186-bede-8b779585ca62 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:52.602503 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-989160f4-4436-4186-bede-8b779585ca62 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:52.631301 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:52.635779 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff8ce50a95b742a48500e634db50fb36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f6085f7a1df49ae8e2375e28d7d6792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:52.638048 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-82d491ac-1d07-4247-9cd8-7e80b853989c tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 200 len: 1657 microversion: 2.20 time: 0.300389 Aug 29 19:15:52.654805 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 572/1146] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:15:52 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 1657 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 19:15:52.841076 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-989160f4-4436-4186-bede-8b779585ca62 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:52.853385 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-989160f4-4436-4186-bede-8b779585ca62 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1210 microversion: 2.1 time: 0.296180 Aug 29 19:15:52.853979 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 575/1147] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:52 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1210 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:53.667369 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:53.667999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:53.687938 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:53.688458 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:53.690272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:53.692348 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:53.692999 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:53.695384 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:53.760805 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] HTTP exception thrown: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Request method failure captured: Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 HTTP/1.1 Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6IiQyLUCVrGx4FNobzqN9jPn1pjyNWyk43mZUIle2YJWfP94UoSI5fkezwOGT8wD7ta-5z2vbVah8-uAxtqybkqlOPGS1I2xPIdFFXIEK0KRHK8PBX3ZsAOQWjhP--KJQWxWhSvtqRmWJ2SakZ-QNyVe9UfKCBdcf1lXvCtvItnrk Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:15:53.765081 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}] Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: ff8ce50a95b742a48500e634db50fb36 Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:15:53.767147 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '9713d174-1918-4168-b6e7-bf1359b50155'} Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:15:53.768161 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:15:53.769737 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:15:53.771564 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Returning 404 to user: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:15:53.771564 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-927f50a3-6836-4192-8cff-c905dbcf0795 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 404 len: 111 microversion: 2.20 time: 0.109804 Aug 29 19:15:53.773201 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 573/1148] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:15:53 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:15:53.783007 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3c238d22-da4e-4971-be16-bb753d9849eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '.version_select at 0x7f3d764f4280>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:53.833047 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3c238d22-da4e-4971-be16-bb753d9849eb tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348536362" status: 204 len: 0 microversion: 2.20 time: 0.052579 Aug 29 19:15:53.835899 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 576/1149] 10.222.0.94 () {60 vars in 1262 bytes} [Mon Aug 29 19:15:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1348536362 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 19:15:53.881556 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6e905694-c412-4ce5-996d-7a9b1985863b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:53.883542 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6e905694-c412-4ce5-996d-7a9b1985863b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:53.907797 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e905694-c412-4ce5-996d-7a9b1985863b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:53.908559 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e905694-c412-4ce5-996d-7a9b1985863b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:53.909174 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e905694-c412-4ce5-996d-7a9b1985863b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:53.913346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e905694-c412-4ce5-996d-7a9b1985863b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:53.914360 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e905694-c412-4ce5-996d-7a9b1985863b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:53.915574 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e905694-c412-4ce5-996d-7a9b1985863b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:54.357810 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-6e905694-c412-4ce5-996d-7a9b1985863b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:54.371882 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6e905694-c412-4ce5-996d-7a9b1985863b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.498365 Aug 29 19:15:54.373066 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 574/1150] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:53 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:55.394167 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-931e6c45-42ed-450c-9dc2-1e072d6e1a5a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:55.395046 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-931e6c45-42ed-450c-9dc2-1e072d6e1a5a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:55.407361 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-931e6c45-42ed-450c-9dc2-1e072d6e1a5a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:55.407916 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-931e6c45-42ed-450c-9dc2-1e072d6e1a5a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:55.408837 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-931e6c45-42ed-450c-9dc2-1e072d6e1a5a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:55.409782 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-931e6c45-42ed-450c-9dc2-1e072d6e1a5a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:55.410407 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-931e6c45-42ed-450c-9dc2-1e072d6e1a5a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:55.411015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-931e6c45-42ed-450c-9dc2-1e072d6e1a5a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:55.716717 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-86fc0cf3-7657-4375-a97e-be56636ea88a req-ba7b963b-cfab-40a8-99fb-4fb075bc21ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90dfcf09-22cb-4928-bf59-ce0ef3005ee8", "tag": "ef83271a-f512-4e3d-9c4e-ca5ba54b370d"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:15:55.772394 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-86fc0cf3-7657-4375-a97e-be56636ea88a req-ba7b963b-cfab-40a8-99fb-4fb075bc21ab service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:55.772961 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-86fc0cf3-7657-4375-a97e-be56636ea88a req-ba7b963b-cfab-40a8-99fb-4fb075bc21ab service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:55.773328 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-86fc0cf3-7657-4375-a97e-be56636ea88a req-ba7b963b-cfab-40a8-99fb-4fb075bc21ab service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:55.810151 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-86fc0cf3-7657-4375-a97e-be56636ea88a req-ba7b963b-cfab-40a8-99fb-4fb075bc21ab service nova] Creating event network-changed:ef83271a-f512-4e3d-9c4e-ca5ba54b370d for instance 90dfcf09-22cb-4928-bf59-ce0ef3005ee8 on hv-cinder-73126 Aug 29 19:15:55.819599 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-86fc0cf3-7657-4375-a97e-be56636ea88a req-ba7b963b-cfab-40a8-99fb-4fb075bc21ab service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118337 Aug 29 19:15:55.821362 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 575/1151] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:15:55.989994 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-931e6c45-42ed-450c-9dc2-1e072d6e1a5a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:56.004132 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-931e6c45-42ed-450c-9dc2-1e072d6e1a5a tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.612625 Aug 29 19:15:56.005389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 577/1152] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:55 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:57.027062 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3e3230bd-661c-4c29-b002-b3177b60abd2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:57.028425 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3e3230bd-661c-4c29-b002-b3177b60abd2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:57.035045 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3e3230bd-661c-4c29-b002-b3177b60abd2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:57.035789 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3e3230bd-661c-4c29-b002-b3177b60abd2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:57.036424 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3e3230bd-661c-4c29-b002-b3177b60abd2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:57.037302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3e3230bd-661c-4c29-b002-b3177b60abd2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:57.037933 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3e3230bd-661c-4c29-b002-b3177b60abd2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:57.038533 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3e3230bd-661c-4c29-b002-b3177b60abd2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:57.306139 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3e3230bd-661c-4c29-b002-b3177b60abd2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:57.313915 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3e3230bd-661c-4c29-b002-b3177b60abd2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.291612 Aug 29 19:15:57.314498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 576/1153] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:57 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:58.335679 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-f4e8121d-691a-42f5-bd80-364a4c6edf6c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:58.336294 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-f4e8121d-691a-42f5-bd80-364a4c6edf6c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:58.344842 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f4e8121d-691a-42f5-bd80-364a4c6edf6c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:58.345336 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f4e8121d-691a-42f5-bd80-364a4c6edf6c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:58.345829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f4e8121d-691a-42f5-bd80-364a4c6edf6c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:58.346547 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f4e8121d-691a-42f5-bd80-364a4c6edf6c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:58.347178 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f4e8121d-691a-42f5-bd80-364a4c6edf6c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:58.347723 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-f4e8121d-691a-42f5-bd80-364a4c6edf6c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:58.509047 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-f4e8121d-691a-42f5-bd80-364a4c6edf6c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:58.517123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-f4e8121d-691a-42f5-bd80-364a4c6edf6c tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.185665 Aug 29 19:15:58.525323 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 578/1154] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:58 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:15:59.540650 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c1514e61-ca7b-4397-9acc-13eb5029858d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:15:59.541327 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c1514e61-ca7b-4397-9acc-13eb5029858d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:15:59.554873 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1514e61-ca7b-4397-9acc-13eb5029858d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:59.555400 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1514e61-ca7b-4397-9acc-13eb5029858d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:59.555843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1514e61-ca7b-4397-9acc-13eb5029858d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:59.556556 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1514e61-ca7b-4397-9acc-13eb5029858d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:15:59.557021 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1514e61-ca7b-4397-9acc-13eb5029858d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:15:59.557446 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c1514e61-ca7b-4397-9acc-13eb5029858d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:15:59.710393 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c1514e61-ca7b-4397-9acc-13eb5029858d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:15:59.719817 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c1514e61-ca7b-4397-9acc-13eb5029858d tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.185051 Aug 29 19:15:59.720403 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 577/1155] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:15:59 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:16:00.741654 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-0d908e16-22eb-4f3c-85ee-90e01fce660e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:00.742278 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-0d908e16-22eb-4f3c-85ee-90e01fce660e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:00.745082 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:00.750680 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d908e16-22eb-4f3c-85ee-90e01fce660e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:00.751207 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d908e16-22eb-4f3c-85ee-90e01fce660e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:00.751646 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d908e16-22eb-4f3c-85ee-90e01fce660e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:00.752353 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d908e16-22eb-4f3c-85ee-90e01fce660e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:00.752811 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d908e16-22eb-4f3c-85ee-90e01fce660e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:00.753334 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-0d908e16-22eb-4f3c-85ee-90e01fce660e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:01.117765 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-0d908e16-22eb-4f3c-85ee-90e01fce660e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:01.125612 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-0d908e16-22eb-4f3c-85ee-90e01fce660e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.388066 Aug 29 19:16:01.139935 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 579/1156] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:00 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:01.465326 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:01.466827 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:01.470425 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:01.471136 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=6 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:01.477445 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:01.477850 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:01.478288 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:01.478988 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:01.480700 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:01.480700 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:01.503241 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] HTTP exception thrown: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Request method failure captured: Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: DELETE /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 HTTP/1.1 Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6IiQyLUCVrGx4FNobzqN9jPn1pjyNWyk43mZUIle2YJWfP94UoSI5fkezwOGT8wD7ta-5z2vbVah8-uAxtqybkqlOPGS1I2xPIdFFXIEK0KRHK8PBX3ZsAOQWjhP--KJQWxWhSvtqRmWJ2SakZ-QNyVe9UfKCBdcf1lXvCtvItnrk Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:16:01.506733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}] Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: ff8ce50a95b742a48500e634db50fb36 Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:16:01.508346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '9713d174-1918-4168-b6e7-bf1359b50155'} Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:16:01.509115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:16:01.510351 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:16:01.514181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Returning 404 to user: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:16:01.514181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b6862722-2042-4f32-a0a1-f70036e44df1 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "DELETE /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 404 len: 111 microversion: 2.20 time: 0.046908 Aug 29 19:16:01.516864 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:01.517480 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 9713d174-1918-4168-b6e7-bf1359b50155] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:01.519267 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 578/1157] 10.222.0.94 () {60 vars in 1280 bytes} [Mon Aug 29 19:16:01 2022] DELETE /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:16:01.524779 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:01.525269 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:01.525704 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:01.526408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:01.527535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:01.527535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:01.532236 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:01.543495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] HTTP exception thrown: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Request method failure captured: Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 HTTP/1.1 Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6IiQyLUCVrGx4FNobzqN9jPn1pjyNWyk43mZUIle2YJWfP94UoSI5fkezwOGT8wD7ta-5z2vbVah8-uAxtqybkqlOPGS1I2xPIdFFXIEK0KRHK8PBX3ZsAOQWjhP--KJQWxWhSvtqRmWJ2SakZ-QNyVe9UfKCBdcf1lXvCtvItnrk Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:16:01.545492 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}] Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ff8ce50a95b742a48500e634db50fb36 Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:16:01.547989 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '9713d174-1918-4168-b6e7-bf1359b50155'} Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:16:01.549251 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. Aug 29 19:16:01.551520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:16:01.556597 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Returning 404 to user: Instance 9713d174-1918-4168-b6e7-bf1359b50155 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:16:01.558410 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8e3a9f6c-efe6-4c84-925b-9b745c44bb32 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155" status: 404 len: 111 microversion: 2.20 time: 0.044658 Aug 29 19:16:01.562152 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 580/1158] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:16:01 2022] GET /compute/v2.1/servers/9713d174-1918-4168-b6e7-bf1359b50155 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:16:02.151000 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-f5c360bc-c29c-422f-857e-2ed2b8134a00 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:02.151729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-f5c360bc-c29c-422f-857e-2ed2b8134a00 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:02.159819 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5c360bc-c29c-422f-857e-2ed2b8134a00 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:02.160460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5c360bc-c29c-422f-857e-2ed2b8134a00 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:02.160937 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5c360bc-c29c-422f-857e-2ed2b8134a00 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:02.161676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5c360bc-c29c-422f-857e-2ed2b8134a00 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:02.162213 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5c360bc-c29c-422f-857e-2ed2b8134a00 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:02.162729 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-f5c360bc-c29c-422f-857e-2ed2b8134a00 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:02.371165 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-f5c360bc-c29c-422f-857e-2ed2b8134a00 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:02.394810 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-f5c360bc-c29c-422f-857e-2ed2b8134a00 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.248700 Aug 29 19:16:02.408007 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 579/1159] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:02 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:02.766877 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:02.767985 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:02.776551 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:02.777028 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:02.777926 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:02.778713 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:02.779258 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:02.779941 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:02.796411 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] HTTP exception thrown: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Request method failure captured: Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: DELETE /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf HTTP/1.1 Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ6IiQyLUCVrGx4FNobzqN9jPn1pjyNWyk43mZUIle2YJWfP94UoSI5fkezwOGT8wD7ta-5z2vbVah8-uAxtqybkqlOPGS1I2xPIdFFXIEK0KRHK8PBX3ZsAOQWjhP--KJQWxWhSvtqRmWJ2SakZ-QNyVe9UfKCBdcf1lXvCtvItnrk Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:16:02.798311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}] Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: ff8ce50a95b742a48500e634db50fb36 Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:16:02.799800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '4696f764-f3e7-482f-b94e-549896198ddf'} Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:16:02.801566 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:16:02.802823 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:16:02.805587 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Returning 404 to user: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:16:02.806583 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6010587f-9bcb-47b0-aaf5-2ebbfebe4248 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "DELETE /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 404 len: 111 microversion: 2.20 time: 0.043855 Aug 29 19:16:02.810319 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 581/1160] 10.222.0.94 () {60 vars in 1280 bytes} [Mon Aug 29 19:16:02 2022] DELETE /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 19:16:02.816634 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:02.817453 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] [instance: 4696f764-f3e7-482f-b94e-549896198ddf] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:02.826205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:02.826810 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:02.827231 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:02.828016 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:02.828467 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:02.828894 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:02.845125 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] HTTP exception thrown: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Request method failure captured: Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf HTTP/1.1 Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ6IiQyLUCVrGx4FNobzqN9jPn1pjyNWyk43mZUIle2YJWfP94UoSI5fkezwOGT8wD7ta-5z2vbVah8-uAxtqybkqlOPGS1I2xPIdFFXIEK0KRHK8PBX3ZsAOQWjhP--KJQWxWhSvtqRmWJ2SakZ-QNyVe9UfKCBdcf1lXvCtvItnrk Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:16:02.846715 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6f6085f7a1df49ae8e2375e28d7d6792"}]}] Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 6f6085f7a1df49ae8e2375e28d7d6792 Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96017432 Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: ff8ce50a95b742a48500e634db50fb36 Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96017432-project Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:16:02.849254 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '4696f764-f3e7-482f-b94e-549896198ddf'} Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:16:02.853644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. Aug 29 19:16:02.855456 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:16:02.856879 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] Returning 404 to user: Instance 4696f764-f3e7-482f-b94e-549896198ddf could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:16:02.856879 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-479803f2-e92b-4395-8d84-c0eac2b64745 tempest-AttachVolumeShelveTestJSON-96017432 tempest-AttachVolumeShelveTestJSON-96017432-project] 10.222.0.94 "GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf" status: 404 len: 111 microversion: 2.20 time: 0.037284 Aug 29 19:16:02.856879 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 580/1161] 10.222.0.94 () {60 vars in 1277 bytes} [Mon Aug 29 19:16:02 2022] GET /compute/v2.1/servers/4696f764-f3e7-482f-b94e-549896198ddf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 29 19:16:03.415493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-08c32fde-eb56-4fe7-b0df-b2110e1fdef9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:03.416127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-08c32fde-eb56-4fe7-b0df-b2110e1fdef9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:03.422088 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-08c32fde-eb56-4fe7-b0df-b2110e1fdef9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:03.422573 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-08c32fde-eb56-4fe7-b0df-b2110e1fdef9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:03.423009 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-08c32fde-eb56-4fe7-b0df-b2110e1fdef9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:03.423732 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-08c32fde-eb56-4fe7-b0df-b2110e1fdef9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:03.424182 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-08c32fde-eb56-4fe7-b0df-b2110e1fdef9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:03.424605 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-08c32fde-eb56-4fe7-b0df-b2110e1fdef9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:03.687232 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-08c32fde-eb56-4fe7-b0df-b2110e1fdef9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:03.696096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-08c32fde-eb56-4fe7-b0df-b2110e1fdef9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.284541 Aug 29 19:16:03.696678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 582/1162] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:03 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:04.717525 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bca90979-03f2-4c2e-9467-b331cbcd30de tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:04.718143 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bca90979-03f2-4c2e-9467-b331cbcd30de tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:04.726799 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bca90979-03f2-4c2e-9467-b331cbcd30de tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:04.727554 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bca90979-03f2-4c2e-9467-b331cbcd30de tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:04.728181 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bca90979-03f2-4c2e-9467-b331cbcd30de tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:04.728889 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bca90979-03f2-4c2e-9467-b331cbcd30de tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:04.729528 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bca90979-03f2-4c2e-9467-b331cbcd30de tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:04.730114 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bca90979-03f2-4c2e-9467-b331cbcd30de tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:04.960495 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-bca90979-03f2-4c2e-9467-b331cbcd30de tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:04.970663 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bca90979-03f2-4c2e-9467-b331cbcd30de tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.257051 Aug 29 19:16:04.971415 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 581/1163] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:04 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:05.993133 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-166e3e8b-470f-4e27-8eab-6e332c603592 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:05.993827 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-166e3e8b-470f-4e27-8eab-6e332c603592 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:06.000546 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-166e3e8b-470f-4e27-8eab-6e332c603592 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:06.001121 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-166e3e8b-470f-4e27-8eab-6e332c603592 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:06.001617 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-166e3e8b-470f-4e27-8eab-6e332c603592 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:06.002405 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-166e3e8b-470f-4e27-8eab-6e332c603592 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:06.002919 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-166e3e8b-470f-4e27-8eab-6e332c603592 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:06.004085 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-166e3e8b-470f-4e27-8eab-6e332c603592 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:06.168188 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-166e3e8b-470f-4e27-8eab-6e332c603592 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:06.188776 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-166e3e8b-470f-4e27-8eab-6e332c603592 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.198934 Aug 29 19:16:06.195880 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 583/1164] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:05 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:07.220960 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1239d139-d735-41c9-83a3-8c87547621e6 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:07.221610 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1239d139-d735-41c9-83a3-8c87547621e6 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:07.229055 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1239d139-d735-41c9-83a3-8c87547621e6 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:07.229541 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1239d139-d735-41c9-83a3-8c87547621e6 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:07.229975 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1239d139-d735-41c9-83a3-8c87547621e6 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:07.230670 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1239d139-d735-41c9-83a3-8c87547621e6 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:07.231142 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1239d139-d735-41c9-83a3-8c87547621e6 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:07.231717 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1239d139-d735-41c9-83a3-8c87547621e6 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:07.399381 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1239d139-d735-41c9-83a3-8c87547621e6 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:07.405416 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:07.415278 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1239d139-d735-41c9-83a3-8c87547621e6 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.198050 Aug 29 19:16:07.416315 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 582/1165] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:07 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:08.437977 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9120b7a9-5f81-4ee5-adb0-3fae5231330e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:08.438565 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9120b7a9-5f81-4ee5-adb0-3fae5231330e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:08.446475 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9120b7a9-5f81-4ee5-adb0-3fae5231330e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:08.446963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9120b7a9-5f81-4ee5-adb0-3fae5231330e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:08.447632 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9120b7a9-5f81-4ee5-adb0-3fae5231330e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:08.448323 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9120b7a9-5f81-4ee5-adb0-3fae5231330e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:08.448947 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9120b7a9-5f81-4ee5-adb0-3fae5231330e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:08.449737 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9120b7a9-5f81-4ee5-adb0-3fae5231330e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:08.622150 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-9120b7a9-5f81-4ee5-adb0-3fae5231330e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:08.630869 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9120b7a9-5f81-4ee5-adb0-3fae5231330e tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.196679 Aug 29 19:16:08.643096 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 584/1166] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:08 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:09.652152 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2d03add9-8cd8-41cc-9d6e-9d98213de1cc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:09.654022 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2d03add9-8cd8-41cc-9d6e-9d98213de1cc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:09.662903 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2d03add9-8cd8-41cc-9d6e-9d98213de1cc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:09.663676 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2d03add9-8cd8-41cc-9d6e-9d98213de1cc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:09.664429 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2d03add9-8cd8-41cc-9d6e-9d98213de1cc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:09.665350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2d03add9-8cd8-41cc-9d6e-9d98213de1cc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:09.666125 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2d03add9-8cd8-41cc-9d6e-9d98213de1cc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:09.666626 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2d03add9-8cd8-41cc-9d6e-9d98213de1cc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:09.905828 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2d03add9-8cd8-41cc-9d6e-9d98213de1cc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:09.915011 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2d03add9-8cd8-41cc-9d6e-9d98213de1cc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.266471 Aug 29 19:16:09.915934 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 583/1167] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:09 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:16:10.936521 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-15912e1b-e480-4c86-8285-01fb53fde7f9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:10.937975 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-15912e1b-e480-4c86-8285-01fb53fde7f9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:10.941675 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:10.948929 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-15912e1b-e480-4c86-8285-01fb53fde7f9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:10.949987 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-15912e1b-e480-4c86-8285-01fb53fde7f9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:10.950622 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-15912e1b-e480-4c86-8285-01fb53fde7f9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:10.951671 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-15912e1b-e480-4c86-8285-01fb53fde7f9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:10.952595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-15912e1b-e480-4c86-8285-01fb53fde7f9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:10.954171 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-15912e1b-e480-4c86-8285-01fb53fde7f9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:11.071005 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-9d868076-25e4-4555-91d0-93a6a8ac851d req-bd97fb7e-cd7e-4893-8be6-7841dc58c06a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90dfcf09-22cb-4928-bf59-ce0ef3005ee8", "name": "network-vif-plugged", "status": "completed", "tag": "ef83271a-f512-4e3d-9c4e-ca5ba54b370d"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:11.079205 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:16:11.085585 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-9d868076-25e4-4555-91d0-93a6a8ac851d req-bd97fb7e-cd7e-4893-8be6-7841dc58c06a service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:11.086467 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-9d868076-25e4-4555-91d0-93a6a8ac851d req-bd97fb7e-cd7e-4893-8be6-7841dc58c06a service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:11.087265 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-9d868076-25e4-4555-91d0-93a6a8ac851d req-bd97fb7e-cd7e-4893-8be6-7841dc58c06a service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:11.108671 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-9d868076-25e4-4555-91d0-93a6a8ac851d req-bd97fb7e-cd7e-4893-8be6-7841dc58c06a service nova] Creating event network-vif-plugged:ef83271a-f512-4e3d-9c4e-ca5ba54b370d for instance 90dfcf09-22cb-4928-bf59-ce0ef3005ee8 on hv-cinder-73126 Aug 29 19:16:11.115816 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-9d868076-25e4-4555-91d0-93a6a8ac851d req-bd97fb7e-cd7e-4893-8be6-7841dc58c06a service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054808 Aug 29 19:16:11.117094 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 584/1168] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:16:11.181290 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-15912e1b-e480-4c86-8285-01fb53fde7f9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:11.193221 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-15912e1b-e480-4c86-8285-01fb53fde7f9 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.259387 Aug 29 19:16:11.194225 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 585/1169] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:10 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:12.216422 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2bdceaa6-c9e4-4b8d-9c1c-3ef93864e347 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:12.217834 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2bdceaa6-c9e4-4b8d-9c1c-3ef93864e347 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:12.225660 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bdceaa6-c9e4-4b8d-9c1c-3ef93864e347 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:12.226152 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bdceaa6-c9e4-4b8d-9c1c-3ef93864e347 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:12.226965 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bdceaa6-c9e4-4b8d-9c1c-3ef93864e347 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:12.227929 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bdceaa6-c9e4-4b8d-9c1c-3ef93864e347 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:12.228590 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bdceaa6-c9e4-4b8d-9c1c-3ef93864e347 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:12.229026 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2bdceaa6-c9e4-4b8d-9c1c-3ef93864e347 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:12.389656 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2bdceaa6-c9e4-4b8d-9c1c-3ef93864e347 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:12.398542 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2bdceaa6-c9e4-4b8d-9c1c-3ef93864e347 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1265 microversion: 2.1 time: 0.187766 Aug 29 19:16:12.399665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 585/1170] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:12 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:13.421611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1b39c2cf-9413-4bfe-81f7-5265d5ae10b2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:13.422328 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1b39c2cf-9413-4bfe-81f7-5265d5ae10b2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:13.430257 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1b39c2cf-9413-4bfe-81f7-5265d5ae10b2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:13.430831 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1b39c2cf-9413-4bfe-81f7-5265d5ae10b2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:13.431495 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1b39c2cf-9413-4bfe-81f7-5265d5ae10b2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:13.432306 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1b39c2cf-9413-4bfe-81f7-5265d5ae10b2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:13.432835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1b39c2cf-9413-4bfe-81f7-5265d5ae10b2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:13.433318 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1b39c2cf-9413-4bfe-81f7-5265d5ae10b2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:13.603665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-1b39c2cf-9413-4bfe-81f7-5265d5ae10b2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:13.611735 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1b39c2cf-9413-4bfe-81f7-5265d5ae10b2 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1453 microversion: 2.1 time: 0.194564 Aug 29 19:16:13.612314 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 586/1171] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:13 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:13.633747 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b04c4816-889c-43a9-849f-cb31ff8a1faf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:16:13.634362 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-b04c4816-889c-43a9-849f-cb31ff8a1faf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:16:13.640894 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04c4816-889c-43a9-849f-cb31ff8a1faf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:13.641377 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04c4816-889c-43a9-849f-cb31ff8a1faf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:13.642036 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04c4816-889c-43a9-849f-cb31ff8a1faf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:13.642728 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04c4816-889c-43a9-849f-cb31ff8a1faf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:13.643211 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04c4816-889c-43a9-849f-cb31ff8a1faf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:13.643649 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-b04c4816-889c-43a9-849f-cb31ff8a1faf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:13.807494 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-b04c4816-889c-43a9-849f-cb31ff8a1faf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:16:13.812467 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b04c4816-889c-43a9-849f-cb31ff8a1faf tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1453 microversion: 2.1 time: 0.182565 Aug 29 19:16:13.828250 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 586/1172] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:16:13 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1453 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:16:16.052003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-ec03fc7c-fcb8-4682-8eaa-01210089e489 req-b773f9da-ea57-4497-9138-c73b35a51b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90dfcf09-22cb-4928-bf59-ce0ef3005ee8", "tag": "ef83271a-f512-4e3d-9c4e-ca5ba54b370d"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:16:16.070967 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ec03fc7c-fcb8-4682-8eaa-01210089e489 req-b773f9da-ea57-4497-9138-c73b35a51b15 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:16:16.071643 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ec03fc7c-fcb8-4682-8eaa-01210089e489 req-b773f9da-ea57-4497-9138-c73b35a51b15 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:16:16.072305 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-ec03fc7c-fcb8-4682-8eaa-01210089e489 req-b773f9da-ea57-4497-9138-c73b35a51b15 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:16:16.086502 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-ec03fc7c-fcb8-4682-8eaa-01210089e489 req-b773f9da-ea57-4497-9138-c73b35a51b15 service nova] Creating event network-changed:ef83271a-f512-4e3d-9c4e-ca5ba54b370d for instance 90dfcf09-22cb-4928-bf59-ce0ef3005ee8 on hv-cinder-73126 Aug 29 19:16:16.092513 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-ec03fc7c-fcb8-4682-8eaa-01210089e489 req-b773f9da-ea57-4497-9138-c73b35a51b15 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045050 Aug 29 19:16:16.093130 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 587/1173] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:06.249899 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9aa3090b-d66c-4eed-9dd4-817cf04d78a9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Action: 'create', calling method: .version_select at 0x7f3d7620a940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1134923955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMB8lEUMKg+sNk3ojOnVjz51WzJBIYR3xCSeye8cnVeR3OToLS+zAIh7jlW2k9gD72vZEAQWlRw0imtNwV3bxwQxH44s+2g4KiN8+y6fCXNjdqp3ZhejpssR55Bnr2bZQ=="}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:06.255961 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:17:06.256148 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Mon Aug 29 19:17:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.94) !!! Aug 29 19:17:06.257237 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=5 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:06.257915 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=20 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:06.273635 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-9aa3090b-d66c-4eed-9dd4-817cf04d78a9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Getting quotas for project af3f2410b6e94037becf20e9c7908820. Resources: {'key_pairs'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:17:06.277798 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.quota [None req-9aa3090b-d66c-4eed-9dd4-817cf04d78a9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Getting quotas for user 4197287cdb4942f58a59e2016493fd84 and project af3f2410b6e94037becf20e9c7908820. Resources: {'key_pairs'} {{(pid=115967) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:17:06.305697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9aa3090b-d66c-4eed-9dd4-817cf04d78a9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.059903 Aug 29 19:17:06.306297 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 587/1174] 10.222.0.94 () {60 vars in 1159 bytes} [Mon Aug 29 19:17:06 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:06.423499 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1197652918", "imageRef": "053cf338-f013-41be-8c75-8ae88bb10304", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1134923955", "networks": [{"uuid": "4cfaa510-29a5-4abf-8297-886bffbf05f5"}]}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:06.435231 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:17:06.435543 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Mon Aug 29 19:17:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.94) !!! Aug 29 19:17:06.437351 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=5 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:06.438007 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=34 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:06.491859 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.network.neutron [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] validate_networks() for [('4cfaa510-29a5-4abf-8297-886bffbf05f5', None, None, None, None, None)] {{(pid=115968) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 19:17:06.901022 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Flavor limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 19:17:06.901454 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Image limits 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 19:17:06.901936 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Flavor pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 19:17:06.902349 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Image pref 0:0:0 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 19:17:06.902763 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.virt.hardware [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=115968) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 19:17:06.911807 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:06.912287 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:06.912724 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:06.913451 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:06.913905 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:06.914333 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:06.931747 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Getting quotas for project af3f2410b6e94037becf20e9c7908820. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 19:17:06.935720 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.quota [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Getting quotas for user 4197287cdb4942f58a59e2016493fd84 and project af3f2410b6e94037becf20e9c7908820. Resources: {'cores', 'ram', 'instances'} {{(pid=115968) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 19:17:06.947423 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Going to run 1 instances... {{(pid=115968) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 19:17:06.949717 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='053cf338-f013-41be-8c75-8ae88bb10304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=115968) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 19:17:06.998177 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d35de248-d2c6-4ee2-b41c-d97622e9d62f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.579215 Aug 29 19:17:06.998839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 588/1175] 10.222.0.94 () {60 vars in 1147 bytes} [Mon Aug 29 19:17:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 19:17:07.009628 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-479d2278-279f-45dd-8632-41f70199d4c9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:07.010243 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-479d2278-279f-45dd-8632-41f70199d4c9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:07.070514 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-479d2278-279f-45dd-8632-41f70199d4c9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:07.077649 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-479d2278-279f-45dd-8632-41f70199d4c9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1259 microversion: 2.1 time: 0.071907 Aug 29 19:17:07.078216 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 588/1176] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:07 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:08.099103 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-96e2b699-a493-4f69-9321-0d0d9dc1cb30 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:08.099936 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-96e2b699-a493-4f69-9321-0d0d9dc1cb30 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:08.106697 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96e2b699-a493-4f69-9321-0d0d9dc1cb30 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:08.107163 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96e2b699-a493-4f69-9321-0d0d9dc1cb30 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:08.107633 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96e2b699-a493-4f69-9321-0d0d9dc1cb30 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:08.108335 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96e2b699-a493-4f69-9321-0d0d9dc1cb30 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:08.108792 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96e2b699-a493-4f69-9321-0d0d9dc1cb30 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:08.109216 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-96e2b699-a493-4f69-9321-0d0d9dc1cb30 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:08.203205 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-96e2b699-a493-4f69-9321-0d0d9dc1cb30 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:08.211378 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-96e2b699-a493-4f69-9321-0d0d9dc1cb30 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1319 microversion: 2.1 time: 0.116860 Aug 29 19:17:08.211955 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 589/1177] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:08 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1319 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:09.232512 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-4c06e8bd-2fc2-4004-986a-43769c4cdb48 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:09.233214 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-4c06e8bd-2fc2-4004-986a-43769c4cdb48 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:09.241353 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c06e8bd-2fc2-4004-986a-43769c4cdb48 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:09.242636 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c06e8bd-2fc2-4004-986a-43769c4cdb48 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:09.243346 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c06e8bd-2fc2-4004-986a-43769c4cdb48 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:09.244490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c06e8bd-2fc2-4004-986a-43769c4cdb48 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:09.245003 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c06e8bd-2fc2-4004-986a-43769c4cdb48 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:09.245444 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-4c06e8bd-2fc2-4004-986a-43769c4cdb48 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:09.410053 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-4c06e8bd-2fc2-4004-986a-43769c4cdb48 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:09.418965 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-4c06e8bd-2fc2-4004-986a-43769c4cdb48 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.190452 Aug 29 19:17:09.419576 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 589/1178] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:09 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:10.440855 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-7745475e-6650-4e5e-9e44-c6e4bb3efe84 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:10.441607 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-7745475e-6650-4e5e-9e44-c6e4bb3efe84 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:10.448866 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7745475e-6650-4e5e-9e44-c6e4bb3efe84 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:10.449353 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7745475e-6650-4e5e-9e44-c6e4bb3efe84 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:10.449791 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7745475e-6650-4e5e-9e44-c6e4bb3efe84 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:10.450508 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7745475e-6650-4e5e-9e44-c6e4bb3efe84 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:10.450958 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7745475e-6650-4e5e-9e44-c6e4bb3efe84 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:10.451410 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-7745475e-6650-4e5e-9e44-c6e4bb3efe84 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:10.597436 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-7745475e-6650-4e5e-9e44-c6e4bb3efe84 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:10.606218 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-7745475e-6650-4e5e-9e44-c6e4bb3efe84 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.169399 Aug 29 19:17:10.606809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 590/1179] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:10 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:11.627895 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7c5c1de8-cc39-4d03-8d25-c8cc09cf82b8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:11.628665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7c5c1de8-cc39-4d03-8d25-c8cc09cf82b8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:11.636517 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7c5c1de8-cc39-4d03-8d25-c8cc09cf82b8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:11.636997 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7c5c1de8-cc39-4d03-8d25-c8cc09cf82b8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:11.637644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7c5c1de8-cc39-4d03-8d25-c8cc09cf82b8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:11.638561 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7c5c1de8-cc39-4d03-8d25-c8cc09cf82b8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:11.639013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7c5c1de8-cc39-4d03-8d25-c8cc09cf82b8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:11.639483 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7c5c1de8-cc39-4d03-8d25-c8cc09cf82b8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:11.783106 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7c5c1de8-cc39-4d03-8d25-c8cc09cf82b8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:11.791802 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7c5c1de8-cc39-4d03-8d25-c8cc09cf82b8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.167760 Aug 29 19:17:11.792378 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 590/1180] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:11 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:12.814159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d7415e33-5d47-4608-a2c5-2c24e1f1cc4f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:12.815725 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d7415e33-5d47-4608-a2c5-2c24e1f1cc4f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:12.822389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7415e33-5d47-4608-a2c5-2c24e1f1cc4f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:12.822964 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7415e33-5d47-4608-a2c5-2c24e1f1cc4f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:12.823489 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7415e33-5d47-4608-a2c5-2c24e1f1cc4f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:12.824262 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7415e33-5d47-4608-a2c5-2c24e1f1cc4f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:12.824787 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7415e33-5d47-4608-a2c5-2c24e1f1cc4f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:12.825281 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d7415e33-5d47-4608-a2c5-2c24e1f1cc4f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:12.968352 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d7415e33-5d47-4608-a2c5-2c24e1f1cc4f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:12.977732 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d7415e33-5d47-4608-a2c5-2c24e1f1cc4f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.167477 Aug 29 19:17:12.995905 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 591/1181] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:12 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:14.002315 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3bffa4f4-5ae9-4502-9fbb-cc446c70ca27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:14.003723 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3bffa4f4-5ae9-4502-9fbb-cc446c70ca27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:14.011024 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3bffa4f4-5ae9-4502-9fbb-cc446c70ca27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:14.011563 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3bffa4f4-5ae9-4502-9fbb-cc446c70ca27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:14.012074 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3bffa4f4-5ae9-4502-9fbb-cc446c70ca27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:14.012849 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3bffa4f4-5ae9-4502-9fbb-cc446c70ca27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:14.013375 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3bffa4f4-5ae9-4502-9fbb-cc446c70ca27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:14.013863 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3bffa4f4-5ae9-4502-9fbb-cc446c70ca27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:14.181592 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3bffa4f4-5ae9-4502-9fbb-cc446c70ca27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:14.189979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3bffa4f4-5ae9-4502-9fbb-cc446c70ca27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.191603 Aug 29 19:17:14.190725 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 591/1182] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:13 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:15.213060 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-62d4771f-3c92-4442-a79d-4a004d8a0651 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:15.213690 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-62d4771f-3c92-4442-a79d-4a004d8a0651 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:15.220254 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62d4771f-3c92-4442-a79d-4a004d8a0651 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:15.220747 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62d4771f-3c92-4442-a79d-4a004d8a0651 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:15.221186 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62d4771f-3c92-4442-a79d-4a004d8a0651 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:15.221896 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62d4771f-3c92-4442-a79d-4a004d8a0651 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:15.222355 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62d4771f-3c92-4442-a79d-4a004d8a0651 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:15.222781 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-62d4771f-3c92-4442-a79d-4a004d8a0651 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:15.403749 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-62d4771f-3c92-4442-a79d-4a004d8a0651 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:15.412699 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-62d4771f-3c92-4442-a79d-4a004d8a0651 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.204008 Aug 29 19:17:15.413292 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 592/1183] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:15 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:16.433334 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-84db101b-0869-4886-92f7-469e4aa74990 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:16.433953 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-84db101b-0869-4886-92f7-469e4aa74990 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:16.440581 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-84db101b-0869-4886-92f7-469e4aa74990 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:16.441063 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-84db101b-0869-4886-92f7-469e4aa74990 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:16.441495 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-84db101b-0869-4886-92f7-469e4aa74990 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:16.442183 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-84db101b-0869-4886-92f7-469e4aa74990 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:16.442855 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-84db101b-0869-4886-92f7-469e4aa74990 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:16.443435 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-84db101b-0869-4886-92f7-469e4aa74990 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:16.577981 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-84db101b-0869-4886-92f7-469e4aa74990 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:16.586232 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-84db101b-0869-4886-92f7-469e4aa74990 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.157017 Aug 29 19:17:16.586797 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 592/1184] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:16 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:17.607992 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-70ae085a-f4aa-48f6-928e-8f3dca7c1c62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:17.608611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-70ae085a-f4aa-48f6-928e-8f3dca7c1c62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:17.610915 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=2 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:17.611624 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell0:SELECT=6 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:17.618185 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-70ae085a-f4aa-48f6-928e-8f3dca7c1c62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:17.618665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-70ae085a-f4aa-48f6-928e-8f3dca7c1c62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:17.619117 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-70ae085a-f4aa-48f6-928e-8f3dca7c1c62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:17.619809 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-70ae085a-f4aa-48f6-928e-8f3dca7c1c62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:17.620258 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-70ae085a-f4aa-48f6-928e-8f3dca7c1c62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:17.620681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-70ae085a-f4aa-48f6-928e-8f3dca7c1c62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:17.760848 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-70ae085a-f4aa-48f6-928e-8f3dca7c1c62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:17.768784 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-70ae085a-f4aa-48f6-928e-8f3dca7c1c62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.164690 Aug 29 19:17:17.769357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 593/1185] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:17 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:18.385031 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-759898d7-7f35-4958-947d-a86e5507bc79 req-45966d66-4f4b-484a-8248-c191e02d2b25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b24b54f-9905-4e1d-bb8d-626eced87f70", "tag": "b0f418fc-ebca-4a43-b11c-fdad08b89852"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:18.391053 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=6 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:18.399470 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-759898d7-7f35-4958-947d-a86e5507bc79 req-45966d66-4f4b-484a-8248-c191e02d2b25 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:18.400358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-759898d7-7f35-4958-947d-a86e5507bc79 req-45966d66-4f4b-484a-8248-c191e02d2b25 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:18.400966 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-759898d7-7f35-4958-947d-a86e5507bc79 req-45966d66-4f4b-484a-8248-c191e02d2b25 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:18.412590 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-759898d7-7f35-4958-947d-a86e5507bc79 req-45966d66-4f4b-484a-8248-c191e02d2b25 service nova] Creating event network-changed:b0f418fc-ebca-4a43-b11c-fdad08b89852 for instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 on hv-cinder-73126 Aug 29 19:17:18.417679 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-759898d7-7f35-4958-947d-a86e5507bc79 req-45966d66-4f4b-484a-8248-c191e02d2b25 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037382 Aug 29 19:17:18.418291 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 593/1186] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:18.790771 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-fd451b8f-c0df-4c55-b06f-6c2ce95b9c41 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:18.791616 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-fd451b8f-c0df-4c55-b06f-6c2ce95b9c41 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:18.798259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd451b8f-c0df-4c55-b06f-6c2ce95b9c41 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:18.798895 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd451b8f-c0df-4c55-b06f-6c2ce95b9c41 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:18.799370 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd451b8f-c0df-4c55-b06f-6c2ce95b9c41 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:18.800084 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd451b8f-c0df-4c55-b06f-6c2ce95b9c41 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:18.800670 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd451b8f-c0df-4c55-b06f-6c2ce95b9c41 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:18.801102 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-fd451b8f-c0df-4c55-b06f-6c2ce95b9c41 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:18.968832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-fd451b8f-c0df-4c55-b06f-6c2ce95b9c41 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:18.976843 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-fd451b8f-c0df-4c55-b06f-6c2ce95b9c41 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.190831 Aug 29 19:17:18.977416 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 594/1187] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:18 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:19.998307 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7d614be3-f707-4f5f-a936-e3155bee8c57 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:19.999018 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7d614be3-f707-4f5f-a936-e3155bee8c57 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:20.006935 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7d614be3-f707-4f5f-a936-e3155bee8c57 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:20.007532 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7d614be3-f707-4f5f-a936-e3155bee8c57 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:20.007982 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7d614be3-f707-4f5f-a936-e3155bee8c57 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:20.008700 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7d614be3-f707-4f5f-a936-e3155bee8c57 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:20.009162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7d614be3-f707-4f5f-a936-e3155bee8c57 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:20.009595 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7d614be3-f707-4f5f-a936-e3155bee8c57 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:20.225323 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7d614be3-f707-4f5f-a936-e3155bee8c57 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:20.233155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7d614be3-f707-4f5f-a936-e3155bee8c57 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.239086 Aug 29 19:17:20.233738 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 594/1188] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:19 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:21.254817 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-c0fd9084-3ac3-4a59-92b6-465651d8a05f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:21.255521 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-c0fd9084-3ac3-4a59-92b6-465651d8a05f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:21.262711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c0fd9084-3ac3-4a59-92b6-465651d8a05f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:21.263226 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c0fd9084-3ac3-4a59-92b6-465651d8a05f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:21.263662 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c0fd9084-3ac3-4a59-92b6-465651d8a05f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:21.264358 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c0fd9084-3ac3-4a59-92b6-465651d8a05f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:21.264805 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c0fd9084-3ac3-4a59-92b6-465651d8a05f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:21.265221 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-c0fd9084-3ac3-4a59-92b6-465651d8a05f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:21.399228 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-c0fd9084-3ac3-4a59-92b6-465651d8a05f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:21.406967 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-c0fd9084-3ac3-4a59-92b6-465651d8a05f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.156274 Aug 29 19:17:21.407580 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 595/1189] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:21 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:22.428869 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8b60e419-5aa4-48eb-b7d1-1f04bdd6865a tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:22.429460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8b60e419-5aa4-48eb-b7d1-1f04bdd6865a tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:22.436809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b60e419-5aa4-48eb-b7d1-1f04bdd6865a tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:22.437234 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b60e419-5aa4-48eb-b7d1-1f04bdd6865a tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:22.437674 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b60e419-5aa4-48eb-b7d1-1f04bdd6865a tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:22.438385 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b60e419-5aa4-48eb-b7d1-1f04bdd6865a tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:22.438837 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b60e419-5aa4-48eb-b7d1-1f04bdd6865a tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:22.439360 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8b60e419-5aa4-48eb-b7d1-1f04bdd6865a tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:22.577772 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-8b60e419-5aa4-48eb-b7d1-1f04bdd6865a tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:22.586071 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8b60e419-5aa4-48eb-b7d1-1f04bdd6865a tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.161608 Aug 29 19:17:22.586659 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 595/1190] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:22 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:23.607577 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5db9920b-5f4f-4bfc-bd14-34aff6c0fee4 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:23.608169 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5db9920b-5f4f-4bfc-bd14-34aff6c0fee4 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:23.616573 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5db9920b-5f4f-4bfc-bd14-34aff6c0fee4 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:23.617119 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5db9920b-5f4f-4bfc-bd14-34aff6c0fee4 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:23.617775 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5db9920b-5f4f-4bfc-bd14-34aff6c0fee4 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:23.618849 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5db9920b-5f4f-4bfc-bd14-34aff6c0fee4 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:23.619582 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5db9920b-5f4f-4bfc-bd14-34aff6c0fee4 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:23.620233 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5db9920b-5f4f-4bfc-bd14-34aff6c0fee4 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:23.763971 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5db9920b-5f4f-4bfc-bd14-34aff6c0fee4 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:23.772519 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5db9920b-5f4f-4bfc-bd14-34aff6c0fee4 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.168796 Aug 29 19:17:23.773099 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 596/1191] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:23 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:24.793242 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-bc4385e1-a061-4374-8d16-ac2959f164ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:24.793838 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-bc4385e1-a061-4374-8d16-ac2959f164ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:24.800561 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc4385e1-a061-4374-8d16-ac2959f164ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:24.801035 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc4385e1-a061-4374-8d16-ac2959f164ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:24.801472 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc4385e1-a061-4374-8d16-ac2959f164ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:24.802285 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc4385e1-a061-4374-8d16-ac2959f164ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:24.802720 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc4385e1-a061-4374-8d16-ac2959f164ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:24.803175 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-bc4385e1-a061-4374-8d16-ac2959f164ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:24.877734 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-bb4d4948-171d-4233-a9b5-aae5595d559f req-7fad4469-5489-42c7-814d-0d675eb0a984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b24b54f-9905-4e1d-bb8d-626eced87f70", "name": "network-vif-plugged", "status": "completed", "tag": "b0f418fc-ebca-4a43-b11c-fdad08b89852"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:24.888397 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-bb4d4948-171d-4233-a9b5-aae5595d559f req-7fad4469-5489-42c7-814d-0d675eb0a984 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:24.889175 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-bb4d4948-171d-4233-a9b5-aae5595d559f req-7fad4469-5489-42c7-814d-0d675eb0a984 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:24.889607 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-bb4d4948-171d-4233-a9b5-aae5595d559f req-7fad4469-5489-42c7-814d-0d675eb0a984 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:24.903181 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-bb4d4948-171d-4233-a9b5-aae5595d559f req-7fad4469-5489-42c7-814d-0d675eb0a984 service nova] Creating event network-vif-plugged:b0f418fc-ebca-4a43-b11c-fdad08b89852 for instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 on hv-cinder-73126 Aug 29 19:17:24.908464 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-bb4d4948-171d-4233-a9b5-aae5595d559f req-7fad4469-5489-42c7-814d-0d675eb0a984 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034776 Aug 29 19:17:24.909286 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 597/1192] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:17:24.977057 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-bc4385e1-a061-4374-8d16-ac2959f164ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:24.985684 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-bc4385e1-a061-4374-8d16-ac2959f164ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.196404 Aug 29 19:17:24.986899 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 596/1193] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:24 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:26.008845 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-302c7ae2-d4c2-4e21-a543-c8c17ed54956 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:26.009458 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-302c7ae2-d4c2-4e21-a543-c8c17ed54956 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:26.015752 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-302c7ae2-d4c2-4e21-a543-c8c17ed54956 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:26.016242 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-302c7ae2-d4c2-4e21-a543-c8c17ed54956 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:26.016676 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-302c7ae2-d4c2-4e21-a543-c8c17ed54956 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:26.017373 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-302c7ae2-d4c2-4e21-a543-c8c17ed54956 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:26.017824 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-302c7ae2-d4c2-4e21-a543-c8c17ed54956 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:26.018245 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-302c7ae2-d4c2-4e21-a543-c8c17ed54956 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:26.150243 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-302c7ae2-d4c2-4e21-a543-c8c17ed54956 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:26.158176 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-302c7ae2-d4c2-4e21-a543-c8c17ed54956 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1359 microversion: 2.1 time: 0.154734 Aug 29 19:17:26.158754 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 598/1194] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:26 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:27.180485 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-22d2c70e-e46d-4b6d-b6f9-eb6768dfa1d9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:27.181092 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-22d2c70e-e46d-4b6d-b6f9-eb6768dfa1d9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:27.187991 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22d2c70e-e46d-4b6d-b6f9-eb6768dfa1d9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:27.188171 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22d2c70e-e46d-4b6d-b6f9-eb6768dfa1d9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:27.188568 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22d2c70e-e46d-4b6d-b6f9-eb6768dfa1d9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:27.189777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22d2c70e-e46d-4b6d-b6f9-eb6768dfa1d9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:27.189777 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22d2c70e-e46d-4b6d-b6f9-eb6768dfa1d9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:27.190123 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-22d2c70e-e46d-4b6d-b6f9-eb6768dfa1d9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:27.321566 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-22d2c70e-e46d-4b6d-b6f9-eb6768dfa1d9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:27.329358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-22d2c70e-e46d-4b6d-b6f9-eb6768dfa1d9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1548 microversion: 2.1 time: 0.153713 Aug 29 19:17:27.329946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 597/1195] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:27 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:27.350106 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6069cb72-e4ca-4c18-a17e-ebc1e820062e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:27.350719 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6069cb72-e4ca-4c18-a17e-ebc1e820062e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:27.357232 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6069cb72-e4ca-4c18-a17e-ebc1e820062e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:27.357709 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6069cb72-e4ca-4c18-a17e-ebc1e820062e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:27.358139 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6069cb72-e4ca-4c18-a17e-ebc1e820062e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:27.358824 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6069cb72-e4ca-4c18-a17e-ebc1e820062e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:27.359311 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6069cb72-e4ca-4c18-a17e-ebc1e820062e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:27.359729 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6069cb72-e4ca-4c18-a17e-ebc1e820062e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:27.493535 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6069cb72-e4ca-4c18-a17e-ebc1e820062e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:27.502860 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6069cb72-e4ca-4c18-a17e-ebc1e820062e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1548 microversion: 2.1 time: 0.157034 Aug 29 19:17:27.504113 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 599/1196] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:27 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:27.524418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-05e32fcc-6f8d-45c0-92ec-7de2bd21d5ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:27.529227 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-05e32fcc-6f8d-45c0-92ec-7de2bd21d5ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:27.529968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-05e32fcc-6f8d-45c0-92ec-7de2bd21d5ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Searching by: {'deleted': False, 'project_id': 'af3f2410b6e94037becf20e9c7908820'} {{(pid=115967) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 19:17:27.537514 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e32fcc-6f8d-45c0-92ec-7de2bd21d5ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:27.538203 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e32fcc-6f8d-45c0-92ec-7de2bd21d5ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:27.538635 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e32fcc-6f8d-45c0-92ec-7de2bd21d5ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:27.539394 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e32fcc-6f8d-45c0-92ec-7de2bd21d5ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:27.539922 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e32fcc-6f8d-45c0-92ec-7de2bd21d5ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:27.540350 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-05e32fcc-6f8d-45c0-92ec-7de2bd21d5ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:27.635514 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.multi_cell_list [None req-05e32fcc-6f8d-45c0-92ec-7de2bd21d5ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=115967) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 19:17:27.734579 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-05e32fcc-6f8d-45c0-92ec-7de2bd21d5ac tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.214204 Aug 29 19:17:27.735050 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 598/1197] 10.222.0.94 () {58 vars in 1125 bytes} [Mon Aug 29 19:17:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:27.746545 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-a07a616d-a7d5-4173-8bae-c8e110e2d6ea tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:27.747202 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-a07a616d-a7d5-4173-8bae-c8e110e2d6ea tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:27.753486 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07a616d-a7d5-4173-8bae-c8e110e2d6ea tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:27.753976 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07a616d-a7d5-4173-8bae-c8e110e2d6ea tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:27.754436 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07a616d-a7d5-4173-8bae-c8e110e2d6ea tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:27.755267 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07a616d-a7d5-4173-8bae-c8e110e2d6ea tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:27.755903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07a616d-a7d5-4173-8bae-c8e110e2d6ea tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:27.756336 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-a07a616d-a7d5-4173-8bae-c8e110e2d6ea tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:27.899620 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-a07a616d-a7d5-4173-8bae-c8e110e2d6ea tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:27.907457 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-a07a616d-a7d5-4173-8bae-c8e110e2d6ea tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1548 microversion: 2.1 time: 0.164898 Aug 29 19:17:27.908038 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 600/1198] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:27 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:29.459418 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2dc69a04-e39d-4b17-a0b1-be8d46a3acda tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca0bb16d-e93b-4182-9d94-b5efd07c666d"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:29.461775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2dc69a04-e39d-4b17-a0b1-be8d46a3acda tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:29.468046 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2dc69a04-e39d-4b17-a0b1-be8d46a3acda tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:29.468644 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2dc69a04-e39d-4b17-a0b1-be8d46a3acda tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:29.468985 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2dc69a04-e39d-4b17-a0b1-be8d46a3acda tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:29.469680 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2dc69a04-e39d-4b17-a0b1-be8d46a3acda tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:29.470143 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2dc69a04-e39d-4b17-a0b1-be8d46a3acda tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:29.470572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2dc69a04-e39d-4b17-a0b1-be8d46a3acda tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:29.762721 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2dc69a04-e39d-4b17-a0b1-be8d46a3acda tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "POST /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307344 Aug 29 19:17:29.763283 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 599/1199] 10.222.0.94 () {60 vars in 1323 bytes} [Mon Aug 29 19:17:29 2022] POST /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:37.378935 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-55a8c309-f230-4053-afb4-35ba9bc130ce tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:37.379598 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-55a8c309-f230-4053-afb4-35ba9bc130ce tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:37.382853 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:37.389857 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-55a8c309-f230-4053-afb4-35ba9bc130ce tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:37.390340 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-55a8c309-f230-4053-afb4-35ba9bc130ce tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:37.390770 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-55a8c309-f230-4053-afb4-35ba9bc130ce tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:37.391625 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-55a8c309-f230-4053-afb4-35ba9bc130ce tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:37.392076 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-55a8c309-f230-4053-afb4-35ba9bc130ce tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:37.392493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-55a8c309-f230-4053-afb4-35ba9bc130ce tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:37.395179 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=71 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:37.531247 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-55a8c309-f230-4053-afb4-35ba9bc130ce tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:37.540128 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-55a8c309-f230-4053-afb4-35ba9bc130ce tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1594 microversion: 2.1 time: 0.164954 Aug 29 19:17:37.540872 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 601/1200] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:37 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1594 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:39.644427 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell0:SELECT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:39.644427 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:39.647995 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-e4fb0c2c-1b56-4514-aad6-3da15f0083d6 req-94fe25e1-b957-4348-8227-ab2ac3706aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b24b54f-9905-4e1d-bb8d-626eced87f70", "tag": "b0f418fc-ebca-4a43-b11c-fdad08b89852"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:39.659795 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-e4fb0c2c-1b56-4514-aad6-3da15f0083d6 req-94fe25e1-b957-4348-8227-ab2ac3706aa5 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:39.660280 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-e4fb0c2c-1b56-4514-aad6-3da15f0083d6 req-94fe25e1-b957-4348-8227-ab2ac3706aa5 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:39.661030 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-e4fb0c2c-1b56-4514-aad6-3da15f0083d6 req-94fe25e1-b957-4348-8227-ab2ac3706aa5 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:39.666657 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:17:39.686826 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-e4fb0c2c-1b56-4514-aad6-3da15f0083d6 req-94fe25e1-b957-4348-8227-ab2ac3706aa5 service nova] Creating event network-changed:b0f418fc-ebca-4a43-b11c-fdad08b89852 for instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 on hv-cinder-73126 Aug 29 19:17:39.692150 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-e4fb0c2c-1b56-4514-aad6-3da15f0083d6 req-94fe25e1-b957-4348-8227-ab2ac3706aa5 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051573 Aug 29 19:17:39.693222 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 600/1201] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:17:40.675138 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-1cb0e68c-0d18-452d-b654-e9fdde8f0560 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-147205429"}} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:40.675983 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-1cb0e68c-0d18-452d-b654-e9fdde8f0560 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:40.684030 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1cb0e68c-0d18-452d-b654-e9fdde8f0560 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:40.684520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1cb0e68c-0d18-452d-b654-e9fdde8f0560 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:40.684956 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1cb0e68c-0d18-452d-b654-e9fdde8f0560 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:40.685692 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1cb0e68c-0d18-452d-b654-e9fdde8f0560 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:40.686156 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1cb0e68c-0d18-452d-b654-e9fdde8f0560 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:40.686585 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-1cb0e68c-0d18-452d-b654-e9fdde8f0560 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:40.823737 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.network.security_group_api [None req-1cb0e68c-0d18-452d-b654-e9fdde8f0560 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Adding security group e9508fc8-9025-455a-bb1a-5dc32fcd9452 to port b0f418fc-ebca-4a43-b11c-fdad08b89852 Aug 29 19:17:41.156678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-1cb0e68c-0d18-452d-b654-e9fdde8f0560 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "POST /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/action" status: 202 len: 0 microversion: 2.1 time: 0.485718 Aug 29 19:17:41.157412 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 602/1202] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:17:40 2022] POST /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:17:41.167443 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-07f48e0d-1038-41c6-9b55-897989ebfd3c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:17:41.168221 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-07f48e0d-1038-41c6-9b55-897989ebfd3c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:17:41.177299 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-07f48e0d-1038-41c6-9b55-897989ebfd3c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:41.177899 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-07f48e0d-1038-41c6-9b55-897989ebfd3c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:41.178348 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-07f48e0d-1038-41c6-9b55-897989ebfd3c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:41.179311 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-07f48e0d-1038-41c6-9b55-897989ebfd3c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:41.180128 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-07f48e0d-1038-41c6-9b55-897989ebfd3c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:41.180811 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-07f48e0d-1038-41c6-9b55-897989ebfd3c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:41.344133 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-07f48e0d-1038-41c6-9b55-897989ebfd3c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:17:41.353272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-07f48e0d-1038-41c6-9b55-897989ebfd3c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1757 microversion: 2.1 time: 0.191158 Aug 29 19:17:41.353946 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 601/1203] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:17:41 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:17:41.707633 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-45c18bb0-ce19-424c-baa7-723b91da82b3 req-fac4fdf6-4257-4ad1-afa4-6e07863c22cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b24b54f-9905-4e1d-bb8d-626eced87f70", "tag": "b0f418fc-ebca-4a43-b11c-fdad08b89852"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:17:41.717213 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-45c18bb0-ce19-424c-baa7-723b91da82b3 req-fac4fdf6-4257-4ad1-afa4-6e07863c22cf service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:17:41.717803 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-45c18bb0-ce19-424c-baa7-723b91da82b3 req-fac4fdf6-4257-4ad1-afa4-6e07863c22cf service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:17:41.718230 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-45c18bb0-ce19-424c-baa7-723b91da82b3 req-fac4fdf6-4257-4ad1-afa4-6e07863c22cf service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:17:41.730523 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-45c18bb0-ce19-424c-baa7-723b91da82b3 req-fac4fdf6-4257-4ad1-afa4-6e07863c22cf service nova] Creating event network-changed:b0f418fc-ebca-4a43-b11c-fdad08b89852 for instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 on hv-cinder-73126 Aug 29 19:17:41.735657 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-45c18bb0-ce19-424c-baa7-723b91da82b3 req-fac4fdf6-4257-4ad1-afa4-6e07863c22cf service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032333 Aug 29 19:17:41.736470 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 603/1204] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:03.914535 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-639029e1-5e6a-4522-aed2-c756115f42b9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:03.916843 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-639029e1-5e6a-4522-aed2-c756115f42b9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:03.919395 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=4 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:03.920057 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=7 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:03.926228 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-639029e1-5e6a-4522-aed2-c756115f42b9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:03.926756 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-639029e1-5e6a-4522-aed2-c756115f42b9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:03.927226 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-639029e1-5e6a-4522-aed2-c756115f42b9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:03.928642 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-639029e1-5e6a-4522-aed2-c756115f42b9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:03.929232 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-639029e1-5e6a-4522-aed2-c756115f42b9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:03.929666 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-639029e1-5e6a-4522-aed2-c756115f42b9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:04.031691 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-639029e1-5e6a-4522-aed2-c756115f42b9 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "POST /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/action" status: 202 len: 0 microversion: 2.1 time: 0.121552 Aug 29 19:18:04.032363 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 602/1205] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:18:03 2022] POST /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:18:04.039797 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=5 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:04.040550 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=11 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:04.045580 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-620702a2-4489-4fe7-8442-964319696aed tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:04.046295 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-620702a2-4489-4fe7-8442-964319696aed tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:04.053929 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-620702a2-4489-4fe7-8442-964319696aed tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:04.054557 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-620702a2-4489-4fe7-8442-964319696aed tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:04.055263 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-620702a2-4489-4fe7-8442-964319696aed tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:04.055966 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-620702a2-4489-4fe7-8442-964319696aed tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:04.056410 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-620702a2-4489-4fe7-8442-964319696aed tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:04.056828 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-620702a2-4489-4fe7-8442-964319696aed tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:04.476981 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-620702a2-4489-4fe7-8442-964319696aed tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:04.485620 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-620702a2-4489-4fe7-8442-964319696aed tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1749 microversion: 2.1 time: 0.448162 Aug 29 19:18:04.486218 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 604/1206] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:04 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1749 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:05.508310 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-70ad7a26-ee9d-4136-a2c9-042ef3d58026 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:05.509004 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-70ad7a26-ee9d-4136-a2c9-042ef3d58026 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:05.517811 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-70ad7a26-ee9d-4136-a2c9-042ef3d58026 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:05.519127 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-70ad7a26-ee9d-4136-a2c9-042ef3d58026 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:05.519637 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-70ad7a26-ee9d-4136-a2c9-042ef3d58026 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:05.520848 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-70ad7a26-ee9d-4136-a2c9-042ef3d58026 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:05.522115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-70ad7a26-ee9d-4136-a2c9-042ef3d58026 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:05.522891 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-70ad7a26-ee9d-4136-a2c9-042ef3d58026 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:05.750175 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-70ad7a26-ee9d-4136-a2c9-042ef3d58026 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:05.759914 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-70ad7a26-ee9d-4136-a2c9-042ef3d58026 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.256619 Aug 29 19:18:05.760725 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 603/1207] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:05 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:06.784222 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-485b0754-17c3-40d2-b760-f52cb2f94c27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:06.784829 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-485b0754-17c3-40d2-b760-f52cb2f94c27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:06.791507 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-485b0754-17c3-40d2-b760-f52cb2f94c27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:06.791988 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-485b0754-17c3-40d2-b760-f52cb2f94c27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:06.792419 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-485b0754-17c3-40d2-b760-f52cb2f94c27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:06.793104 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-485b0754-17c3-40d2-b760-f52cb2f94c27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:06.793552 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-485b0754-17c3-40d2-b760-f52cb2f94c27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:06.793966 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-485b0754-17c3-40d2-b760-f52cb2f94c27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:06.949982 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-485b0754-17c3-40d2-b760-f52cb2f94c27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:06.958405 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-485b0754-17c3-40d2-b760-f52cb2f94c27 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.178157 Aug 29 19:18:06.959100 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 605/1208] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:06 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:07.980624 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-2f98d188-f660-4ff7-8d45-10948002216b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:07.981204 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-2f98d188-f660-4ff7-8d45-10948002216b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:07.990545 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f98d188-f660-4ff7-8d45-10948002216b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:07.991035 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f98d188-f660-4ff7-8d45-10948002216b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:07.991725 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f98d188-f660-4ff7-8d45-10948002216b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:07.993020 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f98d188-f660-4ff7-8d45-10948002216b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:07.993882 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f98d188-f660-4ff7-8d45-10948002216b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:07.994697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-2f98d188-f660-4ff7-8d45-10948002216b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:08.158910 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-2f98d188-f660-4ff7-8d45-10948002216b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:08.167893 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-2f98d188-f660-4ff7-8d45-10948002216b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.191320 Aug 29 19:18:08.168470 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 604/1209] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:07 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:18:09.190779 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-3a6b6505-a2af-4c45-bb8b-8edb0b55ceff tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:09.191800 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-3a6b6505-a2af-4c45-bb8b-8edb0b55ceff tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:09.199839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a6b6505-a2af-4c45-bb8b-8edb0b55ceff tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:09.200318 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a6b6505-a2af-4c45-bb8b-8edb0b55ceff tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:09.200750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a6b6505-a2af-4c45-bb8b-8edb0b55ceff tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:09.201434 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a6b6505-a2af-4c45-bb8b-8edb0b55ceff tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:09.202214 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a6b6505-a2af-4c45-bb8b-8edb0b55ceff tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:09.202715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-3a6b6505-a2af-4c45-bb8b-8edb0b55ceff tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:09.348123 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-3a6b6505-a2af-4c45-bb8b-8edb0b55ceff tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:09.357569 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-3a6b6505-a2af-4c45-bb8b-8edb0b55ceff tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.170882 Aug 29 19:18:09.358153 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 606/1210] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:09 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:10.380034 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-230f422f-0ee9-42fc-b5e2-42e6adc691a6 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:10.381882 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-230f422f-0ee9-42fc-b5e2-42e6adc691a6 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:10.388871 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-230f422f-0ee9-42fc-b5e2-42e6adc691a6 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:10.389433 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-230f422f-0ee9-42fc-b5e2-42e6adc691a6 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:10.390106 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-230f422f-0ee9-42fc-b5e2-42e6adc691a6 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:10.391208 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-230f422f-0ee9-42fc-b5e2-42e6adc691a6 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:10.391931 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-230f422f-0ee9-42fc-b5e2-42e6adc691a6 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:10.392580 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-230f422f-0ee9-42fc-b5e2-42e6adc691a6 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:10.555120 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-230f422f-0ee9-42fc-b5e2-42e6adc691a6 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:10.572375 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-230f422f-0ee9-42fc-b5e2-42e6adc691a6 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.196432 Aug 29 19:18:10.572955 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 605/1211] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:10 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:11.594155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-6baf260e-321d-41c4-857b-0e0ca8f0cc58 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:11.594711 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-6baf260e-321d-41c4-857b-0e0ca8f0cc58 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:11.601457 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6baf260e-321d-41c4-857b-0e0ca8f0cc58 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:11.601952 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6baf260e-321d-41c4-857b-0e0ca8f0cc58 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:11.602392 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6baf260e-321d-41c4-857b-0e0ca8f0cc58 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:11.603106 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6baf260e-321d-41c4-857b-0e0ca8f0cc58 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:11.603584 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6baf260e-321d-41c4-857b-0e0ca8f0cc58 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:11.603992 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-6baf260e-321d-41c4-857b-0e0ca8f0cc58 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:11.748174 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-6baf260e-321d-41c4-857b-0e0ca8f0cc58 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:11.757127 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-6baf260e-321d-41c4-857b-0e0ca8f0cc58 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.166941 Aug 29 19:18:11.757707 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 607/1212] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:11 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:12.778434 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-102cda3b-c34c-4311-96f9-ef671adae30b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:12.779056 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-102cda3b-c34c-4311-96f9-ef671adae30b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:12.785951 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-102cda3b-c34c-4311-96f9-ef671adae30b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:12.786441 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-102cda3b-c34c-4311-96f9-ef671adae30b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:12.787028 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-102cda3b-c34c-4311-96f9-ef671adae30b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:12.787955 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-102cda3b-c34c-4311-96f9-ef671adae30b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:12.788482 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-102cda3b-c34c-4311-96f9-ef671adae30b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:12.788911 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-102cda3b-c34c-4311-96f9-ef671adae30b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.070385 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-830a3699-6ae9-4caa-8e6d-1027fb66ede7 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:13.071121 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-830a3699-6ae9-4caa-8e6d-1027fb66ede7 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:13.078249 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-830a3699-6ae9-4caa-8e6d-1027fb66ede7 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:13.078739 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-830a3699-6ae9-4caa-8e6d-1027fb66ede7 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:13.079198 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-830a3699-6ae9-4caa-8e6d-1027fb66ede7 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.080260 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-830a3699-6ae9-4caa-8e6d-1027fb66ede7 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:13.080405 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-830a3699-6ae9-4caa-8e6d-1027fb66ede7 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:13.080782 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-830a3699-6ae9-4caa-8e6d-1027fb66ede7 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.104874 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-102cda3b-c34c-4311-96f9-ef671adae30b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:13.111021 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-830a3699-6ae9-4caa-8e6d-1027fb66ede7 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Going to try to terminate instance {{(pid=115968) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:18:13.113935 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-102cda3b-c34c-4311-96f9-ef671adae30b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.339401 Aug 29 19:18:13.115194 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 606/1213] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:12 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:13.120231 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [req-08507670-49f9-47ee-bda2-7a58bb647cf5 req-f05e49a2-586f-4053-bba8-f45cb76de46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90dfcf09-22cb-4928-bf59-ce0ef3005ee8", "tag": "ef83271a-f512-4e3d-9c4e-ca5ba54b370d"}]} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:13.130086 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-08507670-49f9-47ee-bda2-7a58bb647cf5 req-f05e49a2-586f-4053-bba8-f45cb76de46b service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:13.130754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-08507670-49f9-47ee-bda2-7a58bb647cf5 req-f05e49a2-586f-4053-bba8-f45cb76de46b service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:13.131435 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [req-08507670-49f9-47ee-bda2-7a58bb647cf5 req-f05e49a2-586f-4053-bba8-f45cb76de46b service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.143552 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.compute.server_external_events [req-08507670-49f9-47ee-bda2-7a58bb647cf5 req-f05e49a2-586f-4053-bba8-f45cb76de46b service nova] Creating event network-changed:ef83271a-f512-4e3d-9c4e-ca5ba54b370d for instance 90dfcf09-22cb-4928-bf59-ce0ef3005ee8 on hv-cinder-73126 Aug 29 19:18:13.154677 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [req-08507670-49f9-47ee-bda2-7a58bb647cf5 req-f05e49a2-586f-4053-bba8-f45cb76de46b service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037948 Aug 29 19:18:13.155561 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 607/1214] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:13.213920 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-830a3699-6ae9-4caa-8e6d-1027fb66ede7 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "DELETE /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 204 len: 0 microversion: 2.1 time: 0.147827 Aug 29 19:18:13.215558 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 608/1215] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:18:13 2022] DELETE /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:18:13.225964 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-97a1b4ce-43d7-4236-a701-7ec6b016e241 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:13.226675 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-97a1b4ce-43d7-4236-a701-7ec6b016e241 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:13.233795 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97a1b4ce-43d7-4236-a701-7ec6b016e241 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:13.234290 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97a1b4ce-43d7-4236-a701-7ec6b016e241 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:13.235428 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97a1b4ce-43d7-4236-a701-7ec6b016e241 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.235574 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97a1b4ce-43d7-4236-a701-7ec6b016e241 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:13.235928 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97a1b4ce-43d7-4236-a701-7ec6b016e241 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:13.236358 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-97a1b4ce-43d7-4236-a701-7ec6b016e241 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:13.375979 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-97a1b4ce-43d7-4236-a701-7ec6b016e241 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:13.385538 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-97a1b4ce-43d7-4236-a701-7ec6b016e241 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1577 microversion: 2.1 time: 0.164556 Aug 29 19:18:13.386159 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 608/1216] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:13 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:14.137978 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-965a1fd5-123c-4c72-8613-aab938df8b46 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:14.138681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-965a1fd5-123c-4c72-8613-aab938df8b46 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:14.144799 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-965a1fd5-123c-4c72-8613-aab938df8b46 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:14.145281 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-965a1fd5-123c-4c72-8613-aab938df8b46 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:14.145715 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-965a1fd5-123c-4c72-8613-aab938df8b46 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:14.147148 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-965a1fd5-123c-4c72-8613-aab938df8b46 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:14.147757 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-965a1fd5-123c-4c72-8613-aab938df8b46 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:14.148182 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-965a1fd5-123c-4c72-8613-aab938df8b46 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:14.298018 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-965a1fd5-123c-4c72-8613-aab938df8b46 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:14.307211 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-965a1fd5-123c-4c72-8613-aab938df8b46 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.173513 Aug 29 19:18:14.307835 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 609/1217] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:14 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:14.409256 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-ea37bfed-442b-4426-bc42-95a2644e5521 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:14.409859 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-ea37bfed-442b-4426-bc42-95a2644e5521 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:14.416995 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea37bfed-442b-4426-bc42-95a2644e5521 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:14.417490 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea37bfed-442b-4426-bc42-95a2644e5521 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:14.417932 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea37bfed-442b-4426-bc42-95a2644e5521 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:14.418646 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea37bfed-442b-4426-bc42-95a2644e5521 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:14.419130 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea37bfed-442b-4426-bc42-95a2644e5521 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:14.419559 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-ea37bfed-442b-4426-bc42-95a2644e5521 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:14.590460 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-ea37bfed-442b-4426-bc42-95a2644e5521 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:14.598726 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-ea37bfed-442b-4426-bc42-95a2644e5521 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1577 microversion: 2.1 time: 0.193528 Aug 29 19:18:14.599473 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 609/1218] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:14 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:15.329122 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2aff175f-2c8a-45c8-9497-a7e5c6d707ec tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:15.329782 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2aff175f-2c8a-45c8-9497-a7e5c6d707ec tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:15.337518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2aff175f-2c8a-45c8-9497-a7e5c6d707ec tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:15.338001 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2aff175f-2c8a-45c8-9497-a7e5c6d707ec tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:15.338487 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2aff175f-2c8a-45c8-9497-a7e5c6d707ec tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:15.339648 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2aff175f-2c8a-45c8-9497-a7e5c6d707ec tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:15.340518 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2aff175f-2c8a-45c8-9497-a7e5c6d707ec tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:15.341258 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2aff175f-2c8a-45c8-9497-a7e5c6d707ec tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:15.596237 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2aff175f-2c8a-45c8-9497-a7e5c6d707ec tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:15.606678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2aff175f-2c8a-45c8-9497-a7e5c6d707ec tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.281558 Aug 29 19:18:15.607426 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 610/1219] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:15 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:15.623348 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-aa9477d3-fabb-4337-b2c1-d3bf489c3fe0 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:15.624095 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-aa9477d3-fabb-4337-b2c1-d3bf489c3fe0 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:15.633509 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa9477d3-fabb-4337-b2c1-d3bf489c3fe0 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:15.634087 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa9477d3-fabb-4337-b2c1-d3bf489c3fe0 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:15.634528 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa9477d3-fabb-4337-b2c1-d3bf489c3fe0 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:15.635304 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa9477d3-fabb-4337-b2c1-d3bf489c3fe0 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:15.635767 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa9477d3-fabb-4337-b2c1-d3bf489c3fe0 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:15.636192 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-aa9477d3-fabb-4337-b2c1-d3bf489c3fe0 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:15.745584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-aa9477d3-fabb-4337-b2c1-d3bf489c3fe0 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:15.754088 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-aa9477d3-fabb-4337-b2c1-d3bf489c3fe0 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 200 len: 1392 microversion: 2.1 time: 0.135650 Aug 29 19:18:15.754842 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 610/1220] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:15 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 1392 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:15.760283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-2e7465f7-80d9-4ff0-83a2-413c012bc401 req-1c6ff8f3-1ad1-43bc-8364-ec709e43e0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90dfcf09-22cb-4928-bf59-ce0ef3005ee8", "name": "network-vif-deleted", "tag": "ef83271a-f512-4e3d-9c4e-ca5ba54b370d"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:15.769491 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-2e7465f7-80d9-4ff0-83a2-413c012bc401 req-1c6ff8f3-1ad1-43bc-8364-ec709e43e0fe service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:15.769970 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-2e7465f7-80d9-4ff0-83a2-413c012bc401 req-1c6ff8f3-1ad1-43bc-8364-ec709e43e0fe service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:15.770398 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-2e7465f7-80d9-4ff0-83a2-413c012bc401 req-1c6ff8f3-1ad1-43bc-8364-ec709e43e0fe service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:15.783340 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-2e7465f7-80d9-4ff0-83a2-413c012bc401 req-1c6ff8f3-1ad1-43bc-8364-ec709e43e0fe service nova] Creating event network-vif-deleted:ef83271a-f512-4e3d-9c4e-ca5ba54b370d for instance 90dfcf09-22cb-4928-bf59-ce0ef3005ee8 on hv-cinder-73126 Aug 29 19:18:15.789012 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-2e7465f7-80d9-4ff0-83a2-413c012bc401 req-1c6ff8f3-1ad1-43bc-8364-ec709e43e0fe service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033127 Aug 29 19:18:15.789793 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 611/1221] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:18:16.631327 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-3903e47c-2161-4406-b322-dd2c6b276f9e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:16.632026 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-3903e47c-2161-4406-b322-dd2c6b276f9e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:16.638474 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3903e47c-2161-4406-b322-dd2c6b276f9e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:16.639046 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3903e47c-2161-4406-b322-dd2c6b276f9e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:16.639609 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3903e47c-2161-4406-b322-dd2c6b276f9e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:16.640304 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3903e47c-2161-4406-b322-dd2c6b276f9e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:16.640754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3903e47c-2161-4406-b322-dd2c6b276f9e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:16.641174 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-3903e47c-2161-4406-b322-dd2c6b276f9e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:16.777010 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:16.777706 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 90dfcf09-22cb-4928-bf59-ce0ef3005ee8] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:16.783888 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:16.784382 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:16.784821 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:16.785520 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:16.785978 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:16.786404 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:16.791917 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-3903e47c-2161-4406-b322-dd2c6b276f9e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:16.800040 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] HTTP exception thrown: Instance 90dfcf09-22cb-4928-bf59-ce0ef3005ee8 could not be found. Aug 29 19:18:16.800375 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-3903e47c-2161-4406-b322-dd2c6b276f9e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.172968 Aug 29 19:18:16.801184 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 611/1222] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:16 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Request method failure captured: Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 HTTP/1.1 Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ71YeLhllOhg8guQ8tj9inO7z2Ff1bEPaTezjckEOz8mxTFOlLsAiMGkbcGE7RALOQsuhf9scRnjUvorTlzpcQwjpeV6BZCKbzaKKMs2sMan908NID2pDHb27klKWgE7-ciJIqsjJMNKwd6_asi-wq4lYlN5jchqp0_1c-Zq41FSjg Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 6a4d940594f542808602c7260993f85f Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:18:16.801789 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6a4d940594f542808602c7260993f85f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6a4d940594f542808602c7260993f85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6a4d940594f542808602c7260993f85f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6a4d940594f542808602c7260993f85f"}]}] Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 6a4d940594f542808602c7260993f85f Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-TestVolumeBootPattern-290515198-project Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 8f1c0b2189a041fdb8dbe2a0290ffac8 Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-TestVolumeBootPattern-290515198-project Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 90dfcf09-22cb-4928-bf59-ce0ef3005ee8 could not be found. Aug 29 19:18:16.803963 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '90dfcf09-22cb-4928-bf59-ce0ef3005ee8'} Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90dfcf09-22cb-4928-bf59-ce0ef3005ee8 could not be found. Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:18:16.805839 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90dfcf09-22cb-4928-bf59-ce0ef3005ee8 could not be found. Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90dfcf09-22cb-4928-bf59-ce0ef3005ee8 could not be found. Aug 29 19:18:16.807493 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:16.808993 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Returning 404 to user: Instance 90dfcf09-22cb-4928-bf59-ce0ef3005ee8 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:18:16.808993 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-dabfcaff-7bec-406a-aed8-83b5e6c581f1 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8" status: 404 len: 111 microversion: 2.1 time: 0.031460 Aug 29 19:18:16.808993 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 612/1223] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:16 2022] GET /compute/v2.1/servers/90dfcf09-22cb-4928-bf59-ce0ef3005ee8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:18:17.823090 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-da6f8025-d3d9-4dcc-9000-59e0451ee9f2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:17.824950 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-da6f8025-d3d9-4dcc-9000-59e0451ee9f2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:17.831867 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da6f8025-d3d9-4dcc-9000-59e0451ee9f2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:17.832464 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da6f8025-d3d9-4dcc-9000-59e0451ee9f2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:17.832907 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da6f8025-d3d9-4dcc-9000-59e0451ee9f2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:17.833873 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da6f8025-d3d9-4dcc-9000-59e0451ee9f2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:17.834610 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da6f8025-d3d9-4dcc-9000-59e0451ee9f2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:17.834956 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-da6f8025-d3d9-4dcc-9000-59e0451ee9f2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:17.984581 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-da6f8025-d3d9-4dcc-9000-59e0451ee9f2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:17.994326 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-da6f8025-d3d9-4dcc-9000-59e0451ee9f2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.175882 Aug 29 19:18:17.995640 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 612/1224] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:17 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:19.016421 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-d442c72b-0974-4a71-9592-3c04c71c3109 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:19.017034 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-d442c72b-0974-4a71-9592-3c04c71c3109 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:19.023928 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d442c72b-0974-4a71-9592-3c04c71c3109 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:19.024452 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d442c72b-0974-4a71-9592-3c04c71c3109 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:19.024889 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d442c72b-0974-4a71-9592-3c04c71c3109 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:19.025580 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d442c72b-0974-4a71-9592-3c04c71c3109 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:19.026028 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d442c72b-0974-4a71-9592-3c04c71c3109 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:19.026449 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-d442c72b-0974-4a71-9592-3c04c71c3109 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:19.176521 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-d442c72b-0974-4a71-9592-3c04c71c3109 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:19.186869 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-d442c72b-0974-4a71-9592-3c04c71c3109 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.174301 Aug 29 19:18:19.187470 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 613/1225] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:19 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:20.129693 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-6e909ba6-f9f8-481a-8b74-250679136d25 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:20.131392 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-471f294d-24c7-4251-acdc-3500b88e0271 req-a9eaff0f-4768-4437-92e5-29a1b09db62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79b9dcd0-904c-434b-880c-a80e86c01055", "tag": "adcd197a-d293-4fcc-aa1a-bea1781ba4dc"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:20.132004 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6e909ba6-f9f8-481a-8b74-250679136d25 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:20.141096 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e909ba6-f9f8-481a-8b74-250679136d25 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:20.141379 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e909ba6-f9f8-481a-8b74-250679136d25 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:20.141651 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e909ba6-f9f8-481a-8b74-250679136d25 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:20.142608 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e909ba6-f9f8-481a-8b74-250679136d25 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:20.143037 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e909ba6-f9f8-481a-8b74-250679136d25 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:20.143697 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-6e909ba6-f9f8-481a-8b74-250679136d25 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:20.148132 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-471f294d-24c7-4251-acdc-3500b88e0271 req-a9eaff0f-4768-4437-92e5-29a1b09db62c service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:20.148706 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-471f294d-24c7-4251-acdc-3500b88e0271 req-a9eaff0f-4768-4437-92e5-29a1b09db62c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:20.151880 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-471f294d-24c7-4251-acdc-3500b88e0271 req-a9eaff0f-4768-4437-92e5-29a1b09db62c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:20.163515 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-471f294d-24c7-4251-acdc-3500b88e0271 req-a9eaff0f-4768-4437-92e5-29a1b09db62c service nova] Creating event network-changed:adcd197a-d293-4fcc-aa1a-bea1781ba4dc for instance 79b9dcd0-904c-434b-880c-a80e86c01055 on hv-cinder-73126 Aug 29 19:18:20.169388 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-471f294d-24c7-4251-acdc-3500b88e0271 req-a9eaff0f-4768-4437-92e5-29a1b09db62c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042446 Aug 29 19:18:20.170283 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 614/1226] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 19:18:20.174624 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-6e909ba6-f9f8-481a-8b74-250679136d25 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:18:20.214261 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-33933fe8-7191-44a7-ba80-897d27afd75e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:20.215907 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-33933fe8-7191-44a7-ba80-897d27afd75e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:20.224003 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33933fe8-7191-44a7-ba80-897d27afd75e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:20.225962 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33933fe8-7191-44a7-ba80-897d27afd75e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:20.226611 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33933fe8-7191-44a7-ba80-897d27afd75e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:20.227372 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33933fe8-7191-44a7-ba80-897d27afd75e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:20.227854 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33933fe8-7191-44a7-ba80-897d27afd75e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:20.228256 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-33933fe8-7191-44a7-ba80-897d27afd75e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:20.304809 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-6e909ba6-f9f8-481a-8b74-250679136d25 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "DELETE /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 204 len: 0 microversion: 2.1 time: 0.179364 Aug 29 19:18:20.306367 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 613/1227] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:18:20 2022] DELETE /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:18:20.322498 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-870f5d94-0648-4af8-936d-82c0ef1d48df tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:20.323941 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-870f5d94-0648-4af8-936d-82c0ef1d48df tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:20.339131 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-870f5d94-0648-4af8-936d-82c0ef1d48df tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:20.340749 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-870f5d94-0648-4af8-936d-82c0ef1d48df tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:20.343661 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-870f5d94-0648-4af8-936d-82c0ef1d48df tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:20.345272 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-870f5d94-0648-4af8-936d-82c0ef1d48df tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:20.347441 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-870f5d94-0648-4af8-936d-82c0ef1d48df tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:20.348505 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-870f5d94-0648-4af8-936d-82c0ef1d48df tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:20.560384 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-33933fe8-7191-44a7-ba80-897d27afd75e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:20.572491 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-33933fe8-7191-44a7-ba80-897d27afd75e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.365170 Aug 29 19:18:20.586671 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 615/1228] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:20 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:18:20.603816 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-870f5d94-0648-4af8-936d-82c0ef1d48df tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:20.612306 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-870f5d94-0648-4af8-936d-82c0ef1d48df tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1577 microversion: 2.1 time: 0.300331 Aug 29 19:18:20.613317 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 614/1229] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:20 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1577 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:21.599259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-5d04644f-04c9-4431-bf68-b689418c21d8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:21.600094 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-5d04644f-04c9-4431-bf68-b689418c21d8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:21.606320 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5d04644f-04c9-4431-bf68-b689418c21d8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:21.606832 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5d04644f-04c9-4431-bf68-b689418c21d8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:21.607329 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5d04644f-04c9-4431-bf68-b689418c21d8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:21.608064 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5d04644f-04c9-4431-bf68-b689418c21d8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:21.608475 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5d04644f-04c9-4431-bf68-b689418c21d8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:21.608894 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-5d04644f-04c9-4431-bf68-b689418c21d8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:21.635013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-7952b9f0-c743-44ff-b8dd-555a429fd803 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:21.636377 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-7952b9f0-c743-44ff-b8dd-555a429fd803 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:21.643815 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7952b9f0-c743-44ff-b8dd-555a429fd803 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:21.644312 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7952b9f0-c743-44ff-b8dd-555a429fd803 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:21.644754 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7952b9f0-c743-44ff-b8dd-555a429fd803 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:21.645459 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7952b9f0-c743-44ff-b8dd-555a429fd803 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:21.646779 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7952b9f0-c743-44ff-b8dd-555a429fd803 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:21.647827 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-7952b9f0-c743-44ff-b8dd-555a429fd803 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:21.902567 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-5d04644f-04c9-4431-bf68-b689418c21d8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:21.913994 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-5d04644f-04c9-4431-bf68-b689418c21d8 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1754 microversion: 2.1 time: 0.318538 Aug 29 19:18:21.914928 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 616/1230] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:21 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1754 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:21.941846 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-7952b9f0-c743-44ff-b8dd-555a429fd803 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:21.950507 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-7952b9f0-c743-44ff-b8dd-555a429fd803 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1577 microversion: 2.1 time: 0.320520 Aug 29 19:18:21.951154 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 615/1231] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:21 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1577 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 19:18:22.936145 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-30ff1268-9547-4207-a984-9649278c8135 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:22.937013 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-30ff1268-9547-4207-a984-9649278c8135 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:22.944678 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-30ff1268-9547-4207-a984-9649278c8135 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:22.945264 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-30ff1268-9547-4207-a984-9649278c8135 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:22.945765 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-30ff1268-9547-4207-a984-9649278c8135 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:22.946533 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-30ff1268-9547-4207-a984-9649278c8135 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:22.947048 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-30ff1268-9547-4207-a984-9649278c8135 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:22.947568 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-30ff1268-9547-4207-a984-9649278c8135 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:22.974269 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-1f630045-f524-49dc-8da6-30fcacf1b904 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:22.975682 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-1f630045-f524-49dc-8da6-30fcacf1b904 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:22.982269 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f630045-f524-49dc-8da6-30fcacf1b904 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:22.982894 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f630045-f524-49dc-8da6-30fcacf1b904 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:22.983659 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f630045-f524-49dc-8da6-30fcacf1b904 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:22.984550 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f630045-f524-49dc-8da6-30fcacf1b904 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:22.985106 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f630045-f524-49dc-8da6-30fcacf1b904 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:22.985668 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-1f630045-f524-49dc-8da6-30fcacf1b904 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:23.006543 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:23.227605 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-30ff1268-9547-4207-a984-9649278c8135 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:23.237132 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-30ff1268-9547-4207-a984-9649278c8135 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1757 microversion: 2.1 time: 0.304874 Aug 29 19:18:23.237965 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 617/1232] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:22 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1757 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:23.270884 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-1f630045-f524-49dc-8da6-30fcacf1b904 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1c0b2189a041fdb8dbe2a0290ffac8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a4d940594f542808602c7260993f85f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:23.285625 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-1f630045-f524-49dc-8da6-30fcacf1b904 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 200 len: 1458 microversion: 2.1 time: 0.316287 Aug 29 19:18:23.286449 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 616/1233] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:22 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 1458 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:23.395527 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-b3f66a0e-a0ba-4c67-9682-c690de9e7471 req-1c5a6ea9-0eb3-4900-835d-f09cf4852698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79b9dcd0-904c-434b-880c-a80e86c01055", "name": "network-vif-deleted", "tag": "adcd197a-d293-4fcc-aa1a-bea1781ba4dc"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:23.405476 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-b3f66a0e-a0ba-4c67-9682-c690de9e7471 req-1c5a6ea9-0eb3-4900-835d-f09cf4852698 service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:23.405947 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-b3f66a0e-a0ba-4c67-9682-c690de9e7471 req-1c5a6ea9-0eb3-4900-835d-f09cf4852698 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:23.406402 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-b3f66a0e-a0ba-4c67-9682-c690de9e7471 req-1c5a6ea9-0eb3-4900-835d-f09cf4852698 service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:23.418408 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-b3f66a0e-a0ba-4c67-9682-c690de9e7471 req-1c5a6ea9-0eb3-4900-835d-f09cf4852698 service nova] Creating event network-vif-deleted:adcd197a-d293-4fcc-aa1a-bea1781ba4dc for instance 79b9dcd0-904c-434b-880c-a80e86c01055 on hv-cinder-73126 Aug 29 19:18:23.423356 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-b3f66a0e-a0ba-4c67-9682-c690de9e7471 req-1c5a6ea9-0eb3-4900-835d-f09cf4852698 service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093277 Aug 29 19:18:23.423943 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 618/1234] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:24.309270 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:24.309881 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: 79b9dcd0-904c-434b-880c-a80e86c01055] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:24.316529 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:24.317013 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:24.317448 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:24.318504 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:24.318907 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:24.319366 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:24.332976 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] HTTP exception thrown: Instance 79b9dcd0-904c-434b-880c-a80e86c01055 could not be found. Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Request method failure captured: Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 HTTP/1.1 Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ71YeLhllOhg8guQ8tj9inO7z2Ff1bEPaTezjckEOz8mxTFOlLsAiMGkbcGE7RALOQsuhf9scRnjUvorTlzpcQwjpeV6BZCKbzaKKMs2sMan908NID2pDHb27klKWgE7-ciJIqsjJMNKwd6_asi-wq4lYlN5jchqp0_1c-Zq41FSjg Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 6a4d940594f542808602c7260993f85f Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:18:24.335247 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6a4d940594f542808602c7260993f85f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6a4d940594f542808602c7260993f85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6a4d940594f542808602c7260993f85f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6a4d940594f542808602c7260993f85f"}]}] Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 6a4d940594f542808602c7260993f85f Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-TestVolumeBootPattern-290515198-project Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 8f1c0b2189a041fdb8dbe2a0290ffac8 Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-TestVolumeBootPattern-290515198-project Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance 79b9dcd0-904c-434b-880c-a80e86c01055 could not be found. Aug 29 19:18:24.337607 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': '79b9dcd0-904c-434b-880c-a80e86c01055'} Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79b9dcd0-904c-434b-880c-a80e86c01055 could not be found. Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:18:24.338620 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79b9dcd0-904c-434b-880c-a80e86c01055 could not be found. Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79b9dcd0-904c-434b-880c-a80e86c01055 could not be found. Aug 29 19:18:24.340117 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.341372 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Returning 404 to user: Instance 79b9dcd0-904c-434b-880c-a80e86c01055 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:18:24.341372 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-58e260bd-ccab-4360-8f77-2749493fadca tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055" status: 404 len: 111 microversion: 2.1 time: 0.032013 Aug 29 19:18:24.341372 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 617/1235] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:24 2022] GET /compute/v2.1/servers/79b9dcd0-904c-434b-880c-a80e86c01055 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:18:24.796230 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:24.796820 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:24.803474 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:24.803973 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:24.804414 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:24.805504 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:24.805965 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:24.806389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:24.821109 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] HTTP exception thrown: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Request method failure captured: Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: DELETE /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 HTTP/1.1 Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDQ71YeLhllOhg8guQ8tj9inO7z2Ff1bEPaTezjckEOz8mxTFOlLsAiMGkbcGE7RALOQsuhf9scRnjUvorTlzpcQwjpeV6BZCKbzaKKMs2sMan908NID2pDHb27klKWgE7-ciJIqsjJMNKwd6_asi-wq4lYlN5jchqp0_1c-Zq41FSjg Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: 6a4d940594f542808602c7260993f85f Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:18:24.822794 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6a4d940594f542808602c7260993f85f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6a4d940594f542808602c7260993f85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6a4d940594f542808602c7260993f85f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6a4d940594f542808602c7260993f85f"}]}] Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: 6a4d940594f542808602c7260993f85f Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-TestVolumeBootPattern-290515198-project Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 8f1c0b2189a041fdb8dbe2a0290ffac8 Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-TestVolumeBootPattern-290515198-project Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:18:24.825593 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': 'b52e65bd-038e-4fc8-807e-4e4ce60c8db7'} Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:18:24.826876 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:18:24.828681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.830665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Returning 404 to user: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:18:24.830665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-9e362f44-3085-40e3-9f51-f94a6e9f5fa3 tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "DELETE /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 404 len: 111 microversion: 2.1 time: 0.033015 Aug 29 19:18:24.830665 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 619/1236] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:18:24 2022] DELETE /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:18:24.834097 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:24.834796 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] [instance: b52e65bd-038e-4fc8-807e-4e4ce60c8db7] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:24.841419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:24.841630 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:24.842070 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:24.842775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:24.843269 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:24.843694 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:24.858221 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.wsgi [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] HTTP exception thrown: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Request method failure captured: Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: request: GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 HTTP/1.1 Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept: application/json Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Accept-Encoding: identity Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Connection: close Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Length: 0 Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Content-Type: application/json Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Host: 10.222.0.94 Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Openstack-System-Scope: None Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: User-Agent: python-urllib3/1.26.12 Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Auth-Token: gAAAAABjDQ71YeLhllOhg8guQ8tj9inO7z2Ff1bEPaTezjckEOz8mxTFOlLsAiMGkbcGE7RALOQsuhf9scRnjUvorTlzpcQwjpeV6BZCKbzaKKMs2sMan908NID2pDHb27klKWgE7-ciJIqsjJMNKwd6_asi-wq4lYlN5jchqp0_1c-Zq41FSjg Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Id: None Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Domain-Name: None Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Identity-Status: Confirmed Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Is-Admin-Project: True Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Id: default Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Domain-Name: Default Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Id: 6a4d940594f542808602c7260993f85f Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Project-Name: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Role: member,reader Aug 29 19:18:24.859665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Roles: member,reader Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/6a4d940594f542808602c7260993f85f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_6a4d940594f542808602c7260993f85f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6a4d940594f542808602c7260993f85f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/6a4d940594f542808602c7260993f85f"}]}] Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Id: 6a4d940594f542808602c7260993f85f Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-Tenant-Name: tempest-TestVolumeBootPattern-290515198 Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User: tempest-TestVolumeBootPattern-290515198-project Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Id: default Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Domain-Name: Default Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Id: 8f1c0b2189a041fdb8dbe2a0290ffac8 Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: X-User-Name: tempest-TestVolumeBootPattern-290515198-project Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: method: > Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: exception: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:18:24.861584 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: action_args: {'id': 'b52e65bd-038e-4fc8-807e-4e4ce60c8db7'} Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:18:24.862686 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. Aug 29 19:18:24.864302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: ERROR nova.api.openstack.wsgi Aug 29 19:18:24.866572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Returning 404 to user: Instance b52e65bd-038e-4fc8-807e-4e4ce60c8db7 could not be found. {{(pid=115967) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:18:24.866572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-e9567f67-47d3-4a9c-9e3e-7477d4dcc1fc tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7" status: 404 len: 111 microversion: 2.1 time: 0.031770 Aug 29 19:18:24.866572 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 618/1237] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:24 2022] GET /compute/v2.1/servers/b52e65bd-038e-4fc8-807e-4e4ce60c8db7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 19:18:26.175036 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-e3375555-13e3-45b4-affb-7be0d542968b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] Calling method '.version_select at 0x7f3d7631eb80>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:26.199621 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-e3375555-13e3-45b4-affb-7be0d542968b tempest-TestVolumeBootPattern-290515198 tempest-TestVolumeBootPattern-290515198-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1804926399" status: 202 len: 0 microversion: 2.1 time: 0.031294 Aug 29 19:18:26.200144 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 620/1238] 10.222.0.94 () {58 vars in 1263 bytes} [Mon Aug 29 19:18:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1804926399 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:18:53.795982 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-57119620-c7f4-4821-867e-aa66bc1be209 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-147205429"}} {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:53.796661 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-57119620-c7f4-4821-867e-aa66bc1be209 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:53.798818 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:53.799508 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG dbcounter [-] [115967] Writing DB stats nova_cell1:SELECT=6 {{(pid=115967) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:53.800238 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 19:18:53.800238 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: Mon Aug 29 19:18:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/action (ip 10.222.0.94) !!! Aug 29 19:18:53.808546 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57119620-c7f4-4821-867e-aa66bc1be209 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:53.809025 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57119620-c7f4-4821-867e-aa66bc1be209 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:53.809461 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57119620-c7f4-4821-867e-aa66bc1be209 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:53.810158 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57119620-c7f4-4821-867e-aa66bc1be209 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:53.811305 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57119620-c7f4-4821-867e-aa66bc1be209 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:53.811733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-57119620-c7f4-4821-867e-aa66bc1be209 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:53.953623 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.network.security_group_api [None req-57119620-c7f4-4821-867e-aa66bc1be209 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Removing security group e9508fc8-9025-455a-bb1a-5dc32fcd9452 from port b0f418fc-ebca-4a43-b11c-fdad08b89852 Aug 29 19:18:54.564023 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-57119620-c7f4-4821-867e-aa66bc1be209 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "POST /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/action" status: 202 len: 0 microversion: 2.1 time: 0.772558 Aug 29 19:18:54.564665 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 619/1239] 10.222.0.94 () {60 vars in 1278 bytes} [Mon Aug 29 19:18:53 2022] POST /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/action => generated 0 bytes in 774 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:18:54.569336 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:54.570265 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG dbcounter [-] [115968] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=115968) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 19:18:54.575595 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-e1d1e7cd-acdb-46b5-82c2-6fdd7833701c req-967aaa1b-a7cf-4bd1-8dbc-95954e2154bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b24b54f-9905-4e1d-bb8d-626eced87f70", "tag": "b0f418fc-ebca-4a43-b11c-fdad08b89852"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:54.596517 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-e1d1e7cd-acdb-46b5-82c2-6fdd7833701c req-967aaa1b-a7cf-4bd1-8dbc-95954e2154bb service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:54.597015 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-e1d1e7cd-acdb-46b5-82c2-6fdd7833701c req-967aaa1b-a7cf-4bd1-8dbc-95954e2154bb service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:54.597659 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-e1d1e7cd-acdb-46b5-82c2-6fdd7833701c req-967aaa1b-a7cf-4bd1-8dbc-95954e2154bb service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:54.612351 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-e1d1e7cd-acdb-46b5-82c2-6fdd7833701c req-967aaa1b-a7cf-4bd1-8dbc-95954e2154bb service nova] Creating event network-changed:b0f418fc-ebca-4a43-b11c-fdad08b89852 for instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 on hv-cinder-73126 Aug 29 19:18:54.618247 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-e1d1e7cd-acdb-46b5-82c2-6fdd7833701c req-967aaa1b-a7cf-4bd1-8dbc-95954e2154bb service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049642 Aug 29 19:18:54.619302 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 621/1240] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:55.677470 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-9290f776-1fcc-4177-8bf5-b5b5bd0be9eb tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:55.678033 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-9290f776-1fcc-4177-8bf5-b5b5bd0be9eb tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:55.684722 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9290f776-1fcc-4177-8bf5-b5b5bd0be9eb tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:55.685207 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9290f776-1fcc-4177-8bf5-b5b5bd0be9eb tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:55.685914 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9290f776-1fcc-4177-8bf5-b5b5bd0be9eb tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:55.686638 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9290f776-1fcc-4177-8bf5-b5b5bd0be9eb tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:55.687309 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9290f776-1fcc-4177-8bf5-b5b5bd0be9eb tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:55.687733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-9290f776-1fcc-4177-8bf5-b5b5bd0be9eb tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:55.782660 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.objects.instance [None req-9290f776-1fcc-4177-8bf5-b5b5bd0be9eb tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lazy-loading 'services' on Instance uuid 7b24b54f-9905-4e1d-bb8d-626eced87f70 {{(pid=115967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 19:18:55.875489 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-9290f776-1fcc-4177-8bf5-b5b5bd0be9eb tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "DELETE /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/os-volume_attachments/ca0bb16d-e93b-4182-9d94-b5efd07c666d" status: 202 len: 0 microversion: 2.1 time: 0.202497 Aug 29 19:18:55.880227 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 620/1241] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:18:55 2022] DELETE /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/os-volume_attachments/ca0bb16d-e93b-4182-9d94-b5efd07c666d => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 19:18:55.887768 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-8bd3b8ce-7a32-4b9e-b456-bae5e5584f9f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:55.892432 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-8bd3b8ce-7a32-4b9e-b456-bae5e5584f9f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:55.901048 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8bd3b8ce-7a32-4b9e-b456-bae5e5584f9f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:55.902507 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8bd3b8ce-7a32-4b9e-b456-bae5e5584f9f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:55.903155 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8bd3b8ce-7a32-4b9e-b456-bae5e5584f9f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:55.904468 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8bd3b8ce-7a32-4b9e-b456-bae5e5584f9f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:55.906441 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8bd3b8ce-7a32-4b9e-b456-bae5e5584f9f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:55.906441 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-8bd3b8ce-7a32-4b9e-b456-bae5e5584f9f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:55.938372 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-fbe0b887-8ed8-4ffc-ab5a-67013a726959 req-8807f868-dced-428a-bd76-6e98fe27ea0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b24b54f-9905-4e1d-bb8d-626eced87f70", "tag": "b0f418fc-ebca-4a43-b11c-fdad08b89852"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:18:55.949323 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-fbe0b887-8ed8-4ffc-ab5a-67013a726959 req-8807f868-dced-428a-bd76-6e98fe27ea0e service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:55.949788 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-fbe0b887-8ed8-4ffc-ab5a-67013a726959 req-8807f868-dced-428a-bd76-6e98fe27ea0e service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:55.950216 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-fbe0b887-8ed8-4ffc-ab5a-67013a726959 req-8807f868-dced-428a-bd76-6e98fe27ea0e service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:55.951556 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-8bd3b8ce-7a32-4b9e-b456-bae5e5584f9f tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069201 Aug 29 19:18:55.953381 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 621/1242] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:18:55 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:55.966450 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-fbe0b887-8ed8-4ffc-ab5a-67013a726959 req-8807f868-dced-428a-bd76-6e98fe27ea0e service nova] Creating event network-changed:b0f418fc-ebca-4a43-b11c-fdad08b89852 for instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 on hv-cinder-73126 Aug 29 19:18:55.973722 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-fbe0b887-8ed8-4ffc-ab5a-67013a726959 req-8807f868-dced-428a-bd76-6e98fe27ea0e service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.298621 Aug 29 19:18:55.974862 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 622/1243] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:18:56.967459 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-5158d01f-f7fc-40d7-b582-c6428f4109d2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:56.969706 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-5158d01f-f7fc-40d7-b582-c6428f4109d2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:56.976289 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5158d01f-f7fc-40d7-b582-c6428f4109d2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:56.976775 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5158d01f-f7fc-40d7-b582-c6428f4109d2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:56.977219 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5158d01f-f7fc-40d7-b582-c6428f4109d2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:56.977919 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5158d01f-f7fc-40d7-b582-c6428f4109d2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:56.978377 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5158d01f-f7fc-40d7-b582-c6428f4109d2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:56.978795 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-5158d01f-f7fc-40d7-b582-c6428f4109d2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:57.010968 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-5158d01f-f7fc-40d7-b582-c6428f4109d2 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048094 Aug 29 19:18:57.011579 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 622/1244] 10.222.0.94 () {58 vars in 1302 bytes} [Mon Aug 29 19:18:56 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 19:18:57.023592 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:57.024155 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:57.031111 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:57.031750 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:57.032259 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:57.033001 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:57.033488 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:57.033961 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:57.120924 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] HTTP exception thrown: Instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 is not attached to volume ca0bb16d-e93b-4182-9d94-b5efd07c666d Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Request method failure captured: Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: DELETE /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/os-volume_attachments/ca0bb16d-e93b-4182-9d94-b5efd07c666d HTTP/1.1 Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDRCjD0lhJmCw_-iqRzy05yBZjRKEJ8xF-Pe1-rMohMtSDmYds_ifhhNQ4BrpQM2Be1SA0FMH_dlVYUX7dZ3C_bxz6OkcLizAKHIbn-Zrr1u03SgQuB1sT8FU62s89NxvJlIDftPwXMTBIhDtGTYEuu2YfOEd-SKffkGAWY4nfWwWX-c Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: af3f2410b6e94037becf20e9c7908820 Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-TestMinimumBasicScenario-1816252808 Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:18:57.124755 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:18:57.127413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/af3f2410b6e94037becf20e9c7908820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_af3f2410b6e94037becf20e9c7908820"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/af3f2410b6e94037becf20e9c7908820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/af3f2410b6e94037becf20e9c7908820"}]}] Aug 29 19:18:57.127413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-TestMinimumBasicScenario-1816252808 Aug 29 19:18:57.127413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: af3f2410b6e94037becf20e9c7908820 Aug 29 19:18:57.127413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1816252808 Aug 29 19:18:57.127413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-TestMinimumBasicScenario-1816252808-project Aug 29 19:18:57.127413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:18:57.127413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:18:57.127413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 4197287cdb4942f58a59e2016493fd84 Aug 29 19:18:57.127413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-TestMinimumBasicScenario-1816252808-project Aug 29 19:18:57.127413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:18:57.127413 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 is not attached to volume ca0bb16d-e93b-4182-9d94-b5efd07c666d Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'server_id': '7b24b54f-9905-4e1d-bb8d-626eced87f70', 'id': 'ca0bb16d-e93b-4182-9d94-b5efd07c666d'} Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ca0bb16d-e93b-4182-9d94-b5efd07c666d. Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:18:57.128908 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 is not attached to volume ca0bb16d-e93b-4182-9d94-b5efd07c666d Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 is not attached to volume ca0bb16d-e93b-4182-9d94-b5efd07c666d Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:18:57.130903 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Returning 404 to user: Instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 is not attached to volume ca0bb16d-e93b-4182-9d94-b5efd07c666d {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:18:57.132922 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-243f705f-5712-44b6-b859-66839771b15e tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "DELETE /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/os-volume_attachments/ca0bb16d-e93b-4182-9d94-b5efd07c666d" status: 404 len: 154 microversion: 2.1 time: 0.107941 Aug 29 19:18:57.132922 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 623/1245] 10.222.0.94 () {58 vars in 1416 bytes} [Mon Aug 29 19:18:57 2022] DELETE /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70/os-volume_attachments/ca0bb16d-e93b-4182-9d94-b5efd07c666d => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:18:58.276626 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-829778a8-ede3-44e0-9540-04dfbf7a320c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:58.277175 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-829778a8-ede3-44e0-9540-04dfbf7a320c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:58.284808 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-829778a8-ede3-44e0-9540-04dfbf7a320c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:58.285302 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-829778a8-ede3-44e0-9540-04dfbf7a320c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:58.285752 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-829778a8-ede3-44e0-9540-04dfbf7a320c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:58.286464 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-829778a8-ede3-44e0-9540-04dfbf7a320c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:58.287131 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-829778a8-ede3-44e0-9540-04dfbf7a320c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:58.287390 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-829778a8-ede3-44e0-9540-04dfbf7a320c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:58.314330 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-829778a8-ede3-44e0-9540-04dfbf7a320c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Going to try to terminate instance {{(pid=115967) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 19:18:58.396337 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-829778a8-ede3-44e0-9540-04dfbf7a320c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "DELETE /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 204 len: 0 microversion: 2.1 time: 0.123157 Aug 29 19:18:58.396966 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 623/1246] 10.222.0.94 () {58 vars in 1239 bytes} [Mon Aug 29 19:18:58 2022] DELETE /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 19:18:58.406681 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-2485dfe5-53f1-4ddc-b81d-f591a4ba5a62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:58.407389 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-2485dfe5-53f1-4ddc-b81d-f591a4ba5a62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:58.413817 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2485dfe5-53f1-4ddc-b81d-f591a4ba5a62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:58.414294 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2485dfe5-53f1-4ddc-b81d-f591a4ba5a62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:58.414723 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2485dfe5-53f1-4ddc-b81d-f591a4ba5a62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:58.415447 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2485dfe5-53f1-4ddc-b81d-f591a4ba5a62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:58.415917 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2485dfe5-53f1-4ddc-b81d-f591a4ba5a62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:58.416315 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-2485dfe5-53f1-4ddc-b81d-f591a4ba5a62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:58.562488 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.policy [None req-2485dfe5-53f1-4ddc-b81d-f591a4ba5a62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115968) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:58.570774 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-2485dfe5-53f1-4ddc-b81d-f591a4ba5a62 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1554 microversion: 2.1 time: 0.169020 Aug 29 19:18:58.571396 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 624/1247] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:58 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:18:59.594178 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-d25d8722-57bf-4e1d-9b24-8bc5b690c403 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:18:59.594928 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-d25d8722-57bf-4e1d-9b24-8bc5b690c403 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:18:59.601240 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d25d8722-57bf-4e1d-9b24-8bc5b690c403 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:59.601723 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d25d8722-57bf-4e1d-9b24-8bc5b690c403 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:59.602162 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d25d8722-57bf-4e1d-9b24-8bc5b690c403 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:59.602863 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d25d8722-57bf-4e1d-9b24-8bc5b690c403 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:18:59.603349 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d25d8722-57bf-4e1d-9b24-8bc5b690c403 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:18:59.603780 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-d25d8722-57bf-4e1d-9b24-8bc5b690c403 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:18:59.752166 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-d25d8722-57bf-4e1d-9b24-8bc5b690c403 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:18:59.763733 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-d25d8722-57bf-4e1d-9b24-8bc5b690c403 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1554 microversion: 2.1 time: 0.174357 Aug 29 19:18:59.764434 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 624/1248] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:18:59 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1554 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:00.771704 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [req-cf037e34-0c34-4bed-b63a-4a0a768b1886 req-1e9a8276-a29c-47cb-a20a-10289ae8f01c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b24b54f-9905-4e1d-bb8d-626eced87f70", "name": "network-vif-deleted", "tag": "b0f418fc-ebca-4a43-b11c-fdad08b89852"}]} {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 19:19:00.784114 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-cf037e34-0c34-4bed-b63a-4a0a768b1886 req-1e9a8276-a29c-47cb-a20a-10289ae8f01c service nova] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:00.784614 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-cf037e34-0c34-4bed-b63a-4a0a768b1886 req-1e9a8276-a29c-47cb-a20a-10289ae8f01c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:00.785053 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [req-cf037e34-0c34-4bed-b63a-4a0a768b1886 req-1e9a8276-a29c-47cb-a20a-10289ae8f01c service nova] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:00.794029 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-c845106a-2d7c-4b2c-abd7-bf288b54c39c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:00.794867 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.compute.api [None req-c845106a-2d7c-4b2c-abd7-bf288b54c39c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115967) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:00.797955 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.compute.server_external_events [req-cf037e34-0c34-4bed-b63a-4a0a768b1886 req-1e9a8276-a29c-47cb-a20a-10289ae8f01c service nova] Creating event network-vif-deleted:b0f418fc-ebca-4a43-b11c-fdad08b89852 for instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 on hv-cinder-73126 Aug 29 19:19:00.803673 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [req-cf037e34-0c34-4bed-b63a-4a0a768b1886 req-1e9a8276-a29c-47cb-a20a-10289ae8f01c service nova] 10.222.0.94 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040118 Aug 29 19:19:00.805082 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 625/1249] 10.222.0.94 () {64 vars in 1317 bytes} [Mon Aug 29 19:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 19:19:00.808419 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c845106a-2d7c-4b2c-abd7-bf288b54c39c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:00.808646 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c845106a-2d7c-4b2c-abd7-bf288b54c39c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:00.809115 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c845106a-2d7c-4b2c-abd7-bf288b54c39c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:00.809856 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c845106a-2d7c-4b2c-abd7-bf288b54c39c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:00.811094 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c845106a-2d7c-4b2c-abd7-bf288b54c39c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:00.811704 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG oslo_concurrency.lockutils [None req-c845106a-2d7c-4b2c-abd7-bf288b54c39c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115967) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:00.886700 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.policy [None req-c845106a-2d7c-4b2c-abd7-bf288b54c39c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4197287cdb4942f58a59e2016493fd84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f2410b6e94037becf20e9c7908820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=115967) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 19:19:00.895641 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-c845106a-2d7c-4b2c-abd7-bf288b54c39c tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 200 len: 1344 microversion: 2.1 time: 0.112575 Aug 29 19:19:00.896202 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 625/1250] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:00 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 1344 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 19:19:01.919344 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '>' {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:01.920159 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.compute.api [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] [instance: 7b24b54f-9905-4e1d-bb8d-626eced87f70] Fetching instance by UUID {{(pid=115968) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 19:19:01.927133 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:01.927632 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:01.928077 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:01.929455 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Acquiring lock "85f87a18-97fd-4459-bb91-024e0266a783" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 19:19:01.929975 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 19:19:01.930364 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG oslo_concurrency.lockutils [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Lock "85f87a18-97fd-4459-bb91-024e0266a783" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115968) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 19:19:01.944669 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.wsgi [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] HTTP exception thrown: Instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 could not be found. Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Request method failure captured: Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: request: GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 HTTP/1.1 Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept: application/json Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Accept-Encoding: identity Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Connection: close Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Length: 0 Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Content-Type: application/json Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Host: 10.222.0.94 Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: Openstack-System-Scope: None Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: User-Agent: python-urllib3/1.26.12 Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Auth-Token: gAAAAABjDRCjD0lhJmCw_-iqRzy05yBZjRKEJ8xF-Pe1-rMohMtSDmYds_ifhhNQ4BrpQM2Be1SA0FMH_dlVYUX7dZ3C_bxz6OkcLizAKHIbn-Zrr1u03SgQuB1sT8FU62s89NxvJlIDftPwXMTBIhDtGTYEuu2YfOEd-SKffkGAWY4nfWwWX-c Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Id: None Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Domain-Name: None Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Identity-Status: Confirmed Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Is-Admin-Project: True Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Id: default Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Domain-Name: Default Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Id: af3f2410b6e94037becf20e9c7908820 Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Project-Name: tempest-TestMinimumBasicScenario-1816252808 Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Role: member,reader Aug 29 19:19:01.946357 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Roles: member,reader Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/compute/v2/af3f2410b6e94037becf20e9c7908820"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.94:8080", "publicURL": "http://10.222.0.94:8080/v1/AUTH_af3f2410b6e94037becf20e9c7908820"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/af3f2410b6e94037becf20e9c7908820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.94/volume/v3/af3f2410b6e94037becf20e9c7908820"}]}] Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant: tempest-TestMinimumBasicScenario-1816252808 Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Id: af3f2410b6e94037becf20e9c7908820 Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1816252808 Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User: tempest-TestMinimumBasicScenario-1816252808-project Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Id: default Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Domain-Name: Default Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Id: 4197287cdb4942f58a59e2016493fd84 Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: X-User-Name: tempest-TestMinimumBasicScenario-1816252808-project Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: method: > Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: exception: Instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 could not be found. Aug 29 19:19:01.948118 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: action_args: {'id': '7b24b54f-9905-4e1d-bb8d-626eced87f70'} Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: {{(pid=115968) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 could not be found. Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 19:19:01.949112 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 could not be found. Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 could not be found. Aug 29 19:19:01.951448 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: ERROR nova.api.openstack.wsgi Aug 29 19:19:01.953427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: DEBUG nova.api.openstack.wsgi [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Returning 404 to user: Instance 7b24b54f-9905-4e1d-bb8d-626eced87f70 could not be found. {{(pid=115968) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 19:19:01.953427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: INFO nova.api.openstack.requestlog [None req-8e9c89bd-46fa-4ff5-8efd-e69189aedf8b tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70" status: 404 len: 111 microversion: 2.1 time: 0.033113 Aug 29 19:19:01.953427 dv-cinder-731261-6-iscsi devstack@n-api.service[115968]: [pid: 115968|app: 0|req: 626/1251] 10.222.0.94 () {58 vars in 1236 bytes} [Mon Aug 29 19:19:01 2022] GET /compute/v2.1/servers/7b24b54f-9905-4e1d-bb8d-626eced87f70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 19:19:01.957408 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: DEBUG nova.api.openstack.wsgi [None req-b5cb9703-fd7f-4991-8d57-72bf570b8cc7 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] Calling method '.version_select at 0x7f3d7626f8b0>' {{(pid=115967) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 19:19:01.979583 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: INFO nova.api.openstack.requestlog [None req-b5cb9703-fd7f-4991-8d57-72bf570b8cc7 tempest-TestMinimumBasicScenario-1816252808 tempest-TestMinimumBasicScenario-1816252808-project] 10.222.0.94 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1134923955" status: 202 len: 0 microversion: 2.1 time: 0.025801 Aug 29 19:19:01.980099 dv-cinder-731261-6-iscsi devstack@n-api.service[115967]: [pid: 115967|app: 0|req: 626/1252] 10.222.0.94 () {58 vars in 1272 bytes} [Mon Aug 29 19:19:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1134923955 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)